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A MOTIVATED INTRODUCTION TO CHARACTER SHEAVES AND 
THE ORBIT METHOD FOR UNIPOTENT GROUPS IN POSITIVE 

CHARACTERISTIC 
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Abstract. This article is based on lectures given by the authors in 2005 and 2006. 
Our first goal is to present an introduction to the orbit method with an emphasis on the 
character theory of finite nilpotent groups. The second goal (motivated by a recent work 
of G. Lusztig) is to explain several nontrivial aspects of character theory for finite groups 
of the form G(Fqr>), where G is a unipotent algebraic group over F,. In particular, we 
introduce the notion of a character sheaf for a unipotent group, and provide a toy model 
for the representation-theoretic notion of an L-packet. 
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Introduction 

This paper is an expanded collection of notes for several lectures on the orbit method 
and geometric representation theory given by the authors at the University of Chicago in 
June and October of 2005, and more recently in June of 2006 at the Langlands Program 
conference at CIRM, Luminy (cf. [Bo06b]). These lectures originated in our attempt to 
understand §7 of George Lusztig's remarkable work [Lu03], in which he began investigating 
character theory and the theory of character sheaves for unipotent groups over finite fields 
and pointed out that its features are similar in spirit to those of the theory of character 
sheaves for general reductive groups. In particular, he provided the first example of a 
nontrivial L-packet for representations of unipotent groups. 

Let G be a unipotent algebraic group over a finite field ¥q. For each positive integer 
n, we have a finite nilpotent group G(Fqn), and it is natural to ask whether there is a 
connection between the complex irreducible characters of this group and some objects 
related to the algebraic group G (8)Fq F^. We hope that the answer is positive, and we 
show this for several classes of unipotent groups. We explain some nontrivial aspects of 
this connection, and state several questions and conjectures in this setup. Already at 
the classical level (i.e., before passing from functions to sheaves), some of our questions, 
examples and observations are either new or at least not part of the "common knowl- 
edge" . For instance, we point out that even if the nilpotence class of G is less than the 
characteristic p of the ground field (in which case the orbit method applies), and even 
if G has exponent p, there are important differences from the representation theory of 
unipotent groups over a field of characteristic 0. First of all, the logarithm map identifies 
G, in general, not with its Lie algebra but with a certain Lie ring scheme^, Q, over F^. 
Second, the stabilizer in G of a point of Q* may be disconnected. As a result, a geometric 
orbit of G in g* may correspond not to a single irreducible representation of G{¥qn) but 
to a finite collection of such representations (this is what we call an L-packet). Finally, 
the G-orbits in g* may have odd dimension. It is precisely these three phenomena that 
make the subject very interesting from our point of view. 

However, the main novelty of our work is a general definition of character sheaves and 
L-packets for unipotent groups in positive characteristic, and a collection of conjectures 
about them. On the one hand, we show that our notion of a character sheaf is compatible 
with the orbit method, in the sense that if G is a connected unipotent group over ¥q of 
nilpotence class less than p, so that the Lie ring scheme £| of G and its dual g* are defined, 
then the character sheaves on G^f^F^ are (up to cohomological shift) the (inverse) Fourier 
transforms of irreducible equivariant local systems on the coadjoint orbits for G, as one 
could expect. On the other hand, the definition of a character sheaf is independent of the 
nilpotence class of G, and we hope that character sheaves are closely related to irreducible 
characters of G{¥qn) even in the cases when the orbit method cannot be applied (notably. 

Lie ring is an abelian group g with a biadditive map [•, •] : q x q ^ q satisfying the Jacobi identity 
and the identity [x, x]=0. A Lie ring scheme over a field fc is a Lie ring object in the category of fc-schemes. 



AN INTRODUCTION TO CHARACTER SHEAVES AND THE ORBIT METHOD 3 

when G is the group ULjsi^q of unipotent upper-triangular matrices of size N over Fg where 
N ^ p). We also expect the theory of character sheaves to have apphcations to geometric 
representation theory beyond the study of irreducible characters, but these applications 
lie outside the scope of this article. 

We aimed to make this paper accessible to as large an audience as possible. It is 
essentially self-contained: we carefully state all the results we use and give all the necessary 
definitions, even though we omit a few proofs. For the most part the reader will only need 
a superficial knowledge of algebraic groups over possibly non-algebraically closed fields, 
as well as a few basic facts about representations of finite groups [Sc77]. Some familiarity 
with the classical orbit method [Ki62] would help the reader, but it is not required. 

Another feature of our presentation is a large collection of examples that help motivate 
the main constructions and results of the paper. Among them we would like to mention the 
"fake Heisenberg groups", unipotent algebra groups, and maximal unipotent subgroups 
of symplectic groups. Most of the proofs appearing in this work are straightforward. 

Organization. Given the size of the paper, we would like to assure the reader that 
it does not have to be read in a linear fashion. For instance, the reader looking for a 
basic introduction to the orbit method only needs to read §2, parts of Appendices C, D, 
and Appendix H, while referring to Appendices A and B if necessary (see also [BSx]). 
After that, for a deeper understanding of the geometric aspects of character theory in 
our setting, we recommend reading §§1, 3 and studying the examples presented in §§6, 7. 
Finally, the theory of character sheaves for unipotent groups is explained in §4 and §5. It 
is also possible to read §§1-5 as a self-contained introduction to this theory (some, but 
not all, of this material is presented in [Bo06b]). 

In more detail, the organization of the paper is as follows. In §1 we describe the setup 
of the article, formulate a few questions that arise in the geometric setting, and answer 
them for connected commutative algebraic groups. These questions motivate almost all 
the rest of the paper. In §2 we review the orbit method for finite nilpotent groups. In 
§3 we explain some nontrivial aspects of this method for unipotent groups over finite 
fields, discuss the L-indistinguishability phenomenon, and illustrate our discussion with 
the example of the "fake Heisenberg groups". Wc then move on to an introduction to 
character sheaves in the unipotent setting. In §4 we give an ad hoc definition of character 
sheaves for a connected unipotent group of "small" nilpotence class and explain their 
relationship with irreducible characters. Afterwards, in §5, we give a general definition of 
character sheaves for unipotent groups and show that it agrees with the ad hoc one when 
the latter is applicable. The main body of the paper concludes with §6 and §7 where we 
introduce several classes of examples that are interesting both from the geometric and 
from the group-theoretic points of view. 

The appendices are devoted mostly to background material that could not be explained 
in our lectures due to the time constraints. The first four appendices are purely algebraic. 
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the next three deal with certain geometric aspects, and the last one discusses some coun- 
terexamples. In more detail, Appendix A proves some auxiliary results about irreducible 
characters of finite groups, and Appendix B gives a self-contained introduction to the 
theory of "Heisenberg representations", which is an important special case of the orbit 
method. Appendices C and D contain a proof of the fact that every irreducible repre- 
sentation of a finite nilpotent group is induced from a 1-dimensional representation of a 
subgroup, as well as a detailed discussion of two different constructions of polarizations. 
In particular, we show that the construction due to M. Vergne is very natural from the 
viewpoint of representation theory. Appendix E is a brief summary of what one needs to 
know about derived categories of constructible £-adic complexes, and equivariant versions 
of these categories, in order to read those parts of the paper that are devoted to char- 
acter sheaves. In Appendices F and G we review Serre duality and the Fourier-Deligne 
transform for perfect connected commutative unipotent groups over perfect fields; we also 
recall the definition of perverse sheaves. Finally, the goal of Appendix H is to show that 
certain more-or-less natural conjectures that arise in the context of the orbit method 
for finite nilpotent groups are actually false; the reader familiar with the classical orbit 
method may wish to consult it right away in order to avoid some possible pitfalls. 

Reiiicirk. We would like to emphasize that in this paper we only consider representations 

of groups over algebraically closed fields of characteristic zero, such as C or Q^, whereas 
the ground field for all our geometric objects must have positive characteristic, in order 
for our discussion to be interesting and/or meaningful. 

Acknowledgements. We would like to thank David Kazhdan for his suggestion to pub- 
lish the notes for our lectures, and for many comments on our article which have sig- 
nificantly improved the quality of the presentation. We are grateful to George Lusztig 
for drawing our attention to algebra groups. We are also grateful to David Kazhdan and 
Robert Kottwitz for several useful discussions. We are greatly indebted to Maria Sabitova 
for catching many errors and misprints in our text. Last but not least, we thank Masoud 
Kamgarpour for taking great notes for the first author's lectures, for helpful comments on 
the earlier versions of this paper, and for useful conversations about the various notions 
of a Frobenius morphism. 

Warning. We use two different conventions in different parts of the text. Namely, when 
we study irreducible characters and consider the elementary questions of §1.3, we always 
work either with a finite group usually denoted by F (and sometimes by 11), or with an 
algebraic group G over a finite field ¥g. On the other hand, it is more convenient to for- 
mulate the theory of character sheaves for algebraic groups over an arbitrary algebraically 
closed field k. In this case, we denote such a group by G, and if char k = p and G has an 
Fg-structure, we will denote by Go an algebraic group over such that Go 0¥g k = G. 
More generally, in the sections devoted to character sheaves we follow the standard prac- 
tice (see, e.g., [BBD82]) where the notation for objects over ¥q contains a subscript "0", 
and omission of this subscript indicates extension of scalars to k. 
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1. ELEMENTARY QUESTIONS AND EXAMPLES 

1.1. Algebraic aspects. If F is a finite group, we will write T for the set of isomorphism 
classes of irreducible representations of F over some fixed algebraically closed field E of 
characteristic 0. The "minimal" problem in character theory that one would hke to solve 
is to describe the set F together with the "dimension function" 

dim : F — > N. 

Sometimes one would like to know not only the function dim, but also the map 

X:r^Fun(F), 

where Fun(F) denotes the space of all £^-valued functions on F, and x takes an irreducible 
representation p of F to its character Xpi9) — ^^(fl'j P) (^? G F). Of course, the function x 
contains more information than dim, since dimp = Xp(l), where 1 denotes the identity 
element of F. When F is a finite nilpotent group of "not too large" nilpotence class^ c 
(the precise condition is that c! is prime to |F|, the order of F), Kirillov's orbit method 
gives a rather satisfactory solution of the last problem. We recall it in Section 2. 

In this article we would like to study the problems mentioned above for finite groups 
of the following special type. Let us fix a prime p and an algebraic closure F of Fp. For 
each A; G N, let ¥pk denote the unique subfield of F of order p'^. Let G be an algebraic 
group (i.e., a reduced group scheme of finite type) over a finite subfield Fg C F, and define 
Tn = G{¥gn) for each n G N. The finite groups F„ form an inductive system: if m|n, 
then Fgm C F^n, and so F^ C F„. One would like to study all the sets F„ simultaneously, 
to establish connections between them for various n, and to relate them to the algebraic 
group G. If G is reductive, the theory of character sheaves developed by Lusztig (cf. 
[Lu85], and also [Lu03] and the references therein) solves this problem. 

1.2. A note on Frobenius morphisms. In what follows we will need to work with 
Probenius morphisms for schemes of characteristic p > 0. Since there are several variants 
of these, we will use this subsection to fix our definitions and notation, in order to avoid all 
possible confusion. If 5" is a scheme over Fg, we denote by ^s,q '■ S ^ S the Fg-morphism 
defined as the identity on the underlying topological space, and the map / h- > on local 
sections of the structure sheaf Os- If the scheme S and/or the prime power q are fixed 
throughout a particular discussion, we may omit them from the notation. We say that S 
is perfect if ^ is an automorphism of S. This notion depends only on the characteristic 
of S and not on q, since ii q = p^ for some prime p, then S can be viewed as a scheme 
over Fp, and ^s,q = ^s,p^ whence ^s,q is invertible if and only if ^s,p is- 



We recall that if G is a (discrete or algebraic or Lie, etc.) group, the nilpotence class of G is defined 
as the smallest integer n such that G*^") = {1} (if it exists), where G^"^ is the n-th iterated commutator 
of G, defined inductively by G^°^ = G, G^'"*"^^ = [G, G^'^]. A similar definition applies to Lie rings. 
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If S,T arc two schemes over F^, the two endomorphisms of MorF^(5', T) induced by 
^s,q and ^T,q clearly coincide^. Thus we obtain an endomorphism of Morp^ (S, T) which 
wc denote by Fr^. Note that Fr^ is an automorphism provided either of the two schemes 
S and T is perfect. In particular, we obtain an automorphism Fr^ of the set ^(F) = 
Morpg (Spec F, S) of geometric points of S. For any n e N, it restricts to an automorphism 
of the set S{¥qri)^ which we again denote by Fr^. If S is an algebraic group over F^, then 
Fr^ is a group automorphism. As a rule, it is this automorphism that we refer to below 
as the Frobenius. 

On a few occasions (see §1.7 and §F.l) we will need to use the relative Frobenius 
morphism. If X is a scheme over an arbitrary field k of characteristic p, we will write X(p) 
for the scheme over k obtained as the fiber product of the structure morphism X — > Spec k 
and the morphism p : Spec A; — > Spec A;. By the universal property of the fiber product, 
the morphism ^x,p : X — > X and the structure morphism X — > Spec k induce a morphism 
^x/k '■ X — > X^*') of schemes over Spec k; it is called the relative Frobenius morphism. 

1.3. Elementary questions. In the situation of §1.1, we would hke to pose the following 
questions, even though they are imprecisely stated and probably too naive. 

(1) Do there exist natural "base change maps" 

T^:f^^(f„)^^'(^''"/'«'") (1.1) 

for all pairs of positive integers m|n? Note that we cannot state this question pre- 
cisely because at this point we do not know what "natural" means. However, nat- 
urality should at least include the equivariance of with respect to Fr^, and the 
compatibility condition 

T^^T^o whenever m\n\k. 

We expect that the answer to this question may be negative in general, but positive 
for many interesting classes of examples. For instance, if G is connected and unipotent 
of nilpotence class < p, Kirillov's orbit method provides a positive answer: see §3.3. 
On the other hand, if G is a unipotent algebra group as defined in Section 6, base 
change maps for G were constructed in [Bo06a]; this case is substantially different. 

(2) Assuming that the answer to question (1) is positive, form the direct limit^ 

f:=limf, (1.2) 

n 

with respect to the base change maps, and consider the induced Fr^-equivariant maps 

T„:f„— (f)^^'("/"^"\ (1.3) 



"^In other words, if / : 5* ^ T is an Fg-morphism, then ^x.q ° f ~ f ° 
*We remark that T is not the s 
just one symbol, defined by (1.2). 



^We remark that T is not the set of irreducible characters of any group, but should be thought of as 
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Are the base change maps T„ injectivc (rcsp., surjective)? We know that the answer to 
this question is negative in general; however, the investigation of the conditions under 
which the answer is positive leads to interesting geometric questions. For example, T„ 
is always surjective when G is connected and unipotcnt of nilpotcnce class < p (see 
§3.4), and T„ is always injective when G is a unipotent algebra group (sec [Bo06a]). 

(3) Assuming again that the answer to question (1) is positive, does there exist a "geomet- 
ric object" G defined over Fg together with a FVq-equivariant bijection G{¥) F? 
This question is also not well posed, since we do not define the class of "geometric 
objects" that we will consider. Nevertheless, we expect that the answer is positive for 
many interesting classes of examples of unipotent groups over ¥q. For example, this 
is the case when G is unipotent of nilpotence class < p. For unipotent algebra groups 
the answer is unknown to us at present. (On the other hand, the answer is negative 
for all groups that are not unipotent; see §1.6 for the case G — G^.) 

Definition 1.1. Assume that the answer to question (1) is positive. The fibers of the 
maps (1.3) will be called L-packets, and two irreducible representations of F^ that have 
the same image in F will be said to be L -indistinguishable. The L-indistinguishability 
phenomenon is discussed in more detail in §3.4 and §3.7. 

Remark 1.2. The conjectural notion of L-packct in the representation theory of reductive 
groups over local fields was introduced by R.P. Langlands in [La83]. It is hard to compare 
it with our notion because technically the two definitions are given in quite different terms. 
But the philosophical ideas behind them are the same. 

1.4. Character sheaves. We still consider an algebraic group G over a finite field F^. We 

also fix a prime £ ^ p and take E = as the field of coefficients for our representations. 
According to the conventions of §1.2, we have the absolute Frobenius morphism $g : G — > 
G, and we may extend scalars and form the morphism Fr^ := id : G^f^F — > G^f^F 
of algebraic groups over F (not to be confused with the absolute Frobenius endomorphism 
of G (8)f5 F). Note that the symbol Fr^ has also appeared in §1.2, but the notation 
introduced there is consistent with the one we use here. More precisely, there is a natural 
identification of G{¥) with the set of closed points of G(8>f, IF, and under this identification 
the action of Fr^ introduced in §1.2 corresponds to the action induced by $g (E) id. 

From the point of view of representation theory of finite groups, the study of character 
sheaves is motivated by the following question, which is at least as important as the 
questions posed in §1.3, and should be viewed as a part of that list. 

(4) Does there exist a collection CS{G) of £-adic complexes JF e D^{G 'F,Qi) (the 
notation is explained in §E.l) which enjoy properties (4-i)-(4-iii) below? 

(4-i) The construction of CS{G) only depends on the algebraic group G := G (^f^ F 
and not on G, i.e., the set of isomorphism classes of the complexes in GS{G) is 
invariant under all automorphisms of G as an algebraic group over F. 
(4-ii) The complexes in GS{G) are irreducible perverse sheaves on G, cf. §G.2. 



8 



M. BOYARCHENKO AND V. DRINFELD 



(4-iii) For each n E N, consider the subset CS{G)^'^'^ C CS{G) consisting of those com- 
plexes ^ e CS{G) such that (Fr^)*(:r) ^ J^. Then it is possible to choose an 

isomorphism t/jn,j^ : (Pr^)*(^) T for every T G CSiG)^^ ^ such that ■0fe,^ is 
induced by i)n,T whenever in the sense that 

and such that the trace functions 

defined by 

tn,^(^) = $^(-irtr(^„,^;7i*(^),) 

are precisely the irreducible characters of G(F^n) over Q^. 

Remarks 1.3. (a) In the formula above, W{J^) denotes the i-th cohomology sheaf of the 
complex and W{!F)g is its stalk at the point g e G'(Fqn), which is viewed as a 
Fr^-stable closed point of the group G. Thus ■0n,:F does indeed act on the vector space 
l-C'{T)g, so the formula makes sense. 

(b) The passage from the pair consisting of the complex JF on G and the isomorphism 
ipn,r '■ (P^q)*{^) ^ to the function tn,T on G(Fqn) is known as the functions- 
sheaves correspondence (see, for instance, [SGA4|], Sommes trig.). 

(c) In view of the requirement (4-ii) , the isomorphisms V'n,.^ ^-re unique up to scaling. 

(d) A positive answer to question (4) would yield a positive answer to question (1). In- 
deed, if there exists a collection CS{G) satisfying the properties listed above, then, in 

particular, property (4-iii) implies that there arc natural bijections between G{¥qn) 
and CSiGY^'i for all n G N, and one can use these bijections, together with the 
obvious inclusions CS{G)^^ C CS{G)^'^ for m|n, to define the base change maps. 

If the answer to question (4) is positive, the elements of the collection CS{G) will be 
called the character sheaves on G (which explains the notation). For example, when 
G = GLn, Lusztig proved [Lu85] that the answer to question (4) is indeed positive. 
However, Lusztig showed that the answer is negative for many other connected reductive 
groups. More recently, Lusztig also observed [Lu03] that the answer is negative for some 
classes of connected unipotent groups as well. This observation is explained in §7.9. 

In view of these comments, one may wish to relax condition (4-iii) as follows: instead of 
requiring that the functions tn,T are precisely the irreducible characters of G{¥qn), one can 
merely ask these functions to form a basis for the space of class functions G{¥qn) — > Q^. 
With this formulation, question (4) has a chance of having a positive answer for connected 
algebraic groups G. Indeed, Lusztig proved [Lu85] that this is so for connected reductive 
G, and we conjecture that this is also true for connected unipotent G; see Section 5 where 
the definition of character sheaves for such groups is given, and where the conjecture is 



AN INTRODUCTION TO CHARACTER SHEAVES AND THE ORBIT METHOD 



9 



stated in a precise way. Moreover, we prove (see §5.8) that this conjecture holds whenever 
the nilpotence class of G is < p. In this section (§1.8) we will show that (the strong form 
of) question (4) has a positive answer for connected commutative algebraic groups. 

1.5. Characters of abelian groups. Until the end of the section we study commutative 
algebraic groups. Let us fix a power 5 of a prime number p. Thus we will simply write Pr 
in place of Fr^. Also, by abuse of notation, wc will write Fr in place of Fr whenever this 
cannot cause confusion (an exception is Remark 1.7). We begin by recalling a famous 
theorem of Serge Lang [La56]: if G is an algebraic group over ¥q, and F = G{¥) with the 
natural action of the absolute Galois group ^ = Gal(F/Fg) = Z, then 

{trivial if G is connected, 
finite in general. 

Let G be a commutative algebraic group over ¥q, and put F„ = G(Fgn), as before. We 
will write the group operation in G additively, which differs from Lusztig's convention 
[Lu03] , since he writes it multiplicatively. Accordingly, what Lusztig calls the norm maps 
will be called the trace maps here: 

tr^ : r„ — > Fm for m\n, 

tC(7) = 7 + Fr™(7) + Fr2™(7) + ■ • • + Fr"-™(7). 

Observe that tr^ is the restriction of the group homomorphism 

r;^ = id + Fr™ + ■ ■ ■ + Fr"-™ : F — ^ F. 

Until further notice, we assume that E = C, i.e., wc will work with complex represen- 
tations. The map trj^ is a group homomorphism, so via pullback it induces a map 

t'^r;;, : = Hom(F^, C^) ^ f „ = Hom(F„, C^). 

Note that the maps tr^ are natural in the sense explained in question (1) of §1.3. 

Proposition 1.4 (cf. [LuOS], §4). If G is connected^, this map gives an isomorphism 

r y (r ) 

Remark 1.5. The proposition may fail if G is not connected: for example, consider the 
case where G is a discrete finite abelian group over Fg. 

Proof. Let us write L„ : F ^ F for the n-th Lang isogeny, ^^(7) = Fr"(7) — 7. We have 
to prove the exactness of the sequence 



^Recall that an algebraic group G over a field F is connected if and only \i G ®f F \s connected. 
Indeed, we may assume that F is perfect, and the result follows by noting that the neutral component 
of G ®F F is fixed by Gal{F/F), and hence is defined over F. See also [Wa79], Theorem 6.6. 
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which is equivalent to the exactness of 

Tn^r^^r^^o. (1.4) 

Since G is connected, Lang's theorem imphes that L„ : F — > T is surjective. On the 
other hand, we have Ln = t^o L^, so the map is surjective. Now given 7 G F^, let 
X e F be such that 7 = t^{x). Then x e F„, because Ln{x) — L^(r^(a;)) = Lmi'y) = 0. 
Thus tr^ is also surjective, which means that (1.4) is exact on the right. 

To prove its exactness in the middle, let 7 e F„ be such that tr^(7) = 0; in any case, 
we have 7 = L^{x) for some x e F, and then -L„(x) = tr^(7) = shows that x e F„. □ 

In the situation of the proposition, let us consider F as defined above: F = limF„, the 

n 

transition homomorphisms being the tr^. We see that the natural map 




Gal(F/Fgn) 



is an isomorphism for all n, when G is connected. So in this case the abelian group 
F, together with the action of ^, "captures" the representation theory of all the finite 
groups F„ in a compatible way. Thus we have solved the desired problem at the algebraic 
level, i.e., we have (affirmatively) answered questions (1) and (2) of §1.3. (The preceding 
discussion corresponds more or less to §4 and part of §5 of [Lu03].) 

1.6. Basic examples. Prom the geometric point of view, one should ask whether F can 
be naturally identified with the set of F-points of some commutative group scheme G 
defined over Fg. (Again, "naturally" means in particular that the isomorphism G{¥) = F 
should commute with the action of the Frobenius.) The answer is not always positive. 

Example 1.6. For G = Ga, we claim that F can be naturally identified with Ga(F), so 
that Ga = Ga- Namely, let us fix a nontrivial additive character ip -.Fg C^. For each 
n G N, we can use the ring scheme structure on Ga to define natural maps 

G„(F,n) GjF^n), 

X ^ '0(trF,„/F,(a;-?)). 

These maps are clearly Fr-equivariant and compatible with each other for different n in 
the obvious sense. So, in this case, G exists as a commutative algebraic group. 

Remark 1.7. Let Fr : F ^ F be the group homomorphism corresponding to Fr : F ^ F. 
Using the above identification of F with Ga(F), we can view Fr as an endomorphism of 
Ga{¥). Then 

FY(ii)=ii^/^ ueGa{¥)^¥. (1.5) 
Indeed, checking this for u G F^n amounts to the orthogonality of Pr : F^n F^n with 
respect to the scalar product F^n x F^n — > defined by {x,y) 1— > ■0(tr]ir^„/]trg(xy)). In 
particular, Pr : Ga(F) — > Ga(F) is not induced by a regular map of algebraic varieties. 
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Example 1.8. For G = Gm, the answer to our question is negative. For if G exists, then 
it is easy to show that for a prime I different from charFq, the Tate module Ti{Gm) 
should be dual to the Tate module So Fr : T,(G^) should have q-^ as 

an eigenvalue, which is impossible (the eigenvalues of the Frobenius acting on the Tate 
module of a commutative algebraic group are known to be algebraic integers). 

1.7. Commutative unipotent groups. Let G be an arbitrary connected commutative 
algebraic group over F^. From now on, to avoid confusion, we switch notation and replace 
G with G*. (Thus, the notation G* will always be used in the commutative case, while 
G will be used in the general case.) The argument used in Example 1.8 shows that G* 
cannot exist as a commutative algebraic group over ¥q unless G is unipotent. On the other 
hand, when G is unipotent, it turns out that G* always exists. It is known under the 
name "Serre dual" of G, and the idea of the of duality theory for commutative unipotent 
groups goes back to Scrrc's article [Sc60]. However, in the form needed for our purposes, 
the duality appears to be due to L. Begueri (see [Be80] and [Sa96]). 

To be more precise, let us fix an arbitrary field k of characteristic p. The duality functor 
G I— > is defined as a functor — > C^, where Ck is a certain locahzation of the category 
Ck of connected commutative unipotent algebraic groups over k. (Remark 1.7 shows that 
one cannot expect to have a duality functor Ck — > Ck-) The definition of the localization 
Ck is as follows: one inverts all C^-morphisms / : Ci — > 6*2 such that the corresponding 
map Gi{k) — > G2{k) is bijectivc. (Of course, the same category Ck is obtained if one only 
inverts the relative Frobenius morphism G G^^^ for each G E Ck-) One has G** = G. 

A brief outline of this duality theory is given in Appendix F. The reader may prefer 
to skip it, since for our purposes it is interesting enough to consider only those G E Ck 
which are isomorphic^ to G", and on this full subcategory the duahty functor has the 
following explicit description, which can be used as an ad hoc definition. (Of course, this 
description agrees with Example 1.6 and Remark 1.7.) 

Since the duality functor is additive, it suffices to know how it acts on Ga- One has 

{GaY = Ga, and it remains to describe the anti-automorphism f ^ f* oi the ring 
Endcj.(Ga). In fact, it is enough to describe /* in the cases f{x) = x^, f{x) = x^ , and 
f{x) = cx (this is a system of generators of Endc:^(Ga)). In the first two cases, /* = f~^, 
and in the third case, /* = /. 

1.8. Character sheaves for connected commutative groups. Let G be a connected 
commutative algebraic group over Fg, and let G = G F, as before. Character sheaves 
for G were constructed by Lusztig in §5 of [Lu03]. We will explain this result from a 
somewhat different point of view, which is closer in spirit to Section 5 below. 

^It is well known and easy to prove that if G G Cfc and p ■ G = 0, then = 6^^ for some n. If k is 
perfect, this is already true in Ck- 
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Let a : G X G ^ G denote the group operation. By abuse of notation, the group 
operation on G will also be denoted by a. We define a character sheaf on G to be a 
local system (i.e., a lisse Q^-sheaf) jC of rank 1 on G satisfying «*(£) = C ^ C. The 
collection CS{G) of character sheaves on G clearly satisfies property (4-i) of §1.4. It 
satisfies property (4-ii) up to cohomological shift, in the sense that if £ e CS{G), then 
>C[dimG] is an irreducible perverse sheaf on G (here we use the assumption that G is 
connected). In the present setting we prefer to work with local systems rather than 
perverse sheaves in order to avoid having to keep track of an extra factor of (— 1)"^™*^ in 
our computations. This issue is absolutely unimportant. 

Let us check that CS{G) satisfies property (4-iii). First of all, for each n G N and each 
C G CS(G)^'^" , wc choose the unique isomorphism ihnx ■ (Fr")*£ C which acts as the 
identity on the stalk of £ at 1 G G{¥q). In view of Remark 1.3(c), it is clear that 

^k,c = i^n,c o (Fr")*(^„,£) o (Fr^")*(V^„,£) o • • • o (Fr^-")*(^„,^) : (Fr^)*£ ^ C 
whenever n\k. To complete the verification of property (4-iii), we prove three lemmas. 

Lemma 1.9. The trace function tn,c '■ G{¥qn) — > determined byipn,c (as in takes 
values in , and is a 1-dimensional character of G{¥gn). 

Proof. By Remark 1.3(c), our normalization of ipn,c implies that for any isomorphism 
u : a*jC CMC, the following diagram commutes: 

a*(Fr")*£ = (Fr")*a*£ ^^"^"^ > (Fr'*)*(£ m C) = (Fr")*£ K {Fr'^yC 



a*C ^ CMC 

(By abuse of notation, the equality signs in this diagram stand for the canonical isomor- 
phisms.) Now let 

in,a*£:G'(F,n)xG(F,n)^Q, 

denote the trace function associated to the isomorphism a*ipn,c '■ (Fr")*Q;*>C a*C, as 
in §1.4, and let 

tnmc ■■ ^(F.n) X G(F,n) 

denote the trace function associated to the isomorphism ipn,c M '4>n,c '■ (Fr")*(£ Kl C) 
CMC. Then it is clear that tn,a*/; = oi*tn,c-, the puUback of the function tn^c by the map 
a : G{¥qn) x G{¥qn) — > G(Fgn), whereas tn,cMc — tn,c M tn,C: the function defined by 

itnX^tn,c){9l,92) =tn,c{9l) ' tn,c{92) 9l, 92 ^ G(Fgu). 

The commutativity of the diagram above implies that tn^ M tn^ = Ci*tnXy which is 
equivalent to the statement that tn,c '■ G{¥q«) — > is multiplicative. Since in,£(l) = 1 by 
construction, it follows that tn,c '■ G(¥qn) — > is in fact a (1-dimensional) character. □ 
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The attentive reader may observe that so far we have not used the assumption that G 
is commutative. However, it will be used in the next lemma. 

Lemma 1.10. Every 1-dimensional character x '■ G{¥qn) has the form tn,c for 

someCeCS{G)^'^. 

Proof. Let Ln : G ^ G denote the n-th Lang isogeny, defined by Ln{j) = Fr"(7) — 7 (we 
denote the group operation on G additively, as in §1.5). By Lang's theorem [La56], this 
map makes G a G(Fyn)-torsor over G. In other words, it induces an isomorphism between 
G/G{¥qn) and G. Standard ctalc descent theory implies that pullback via L„ induces 
an equivalence between the category of local systems on G and the category of G(Fgn)- 
equivariant local systems on G, where G{¥qn) acts on G by translations. In particular, 
there exists a (unique up to isomorphism) rank 1 local system £ on G such that L*>C is 
the constant local system equipped with the G'(Fgn)-equivariant structure defined by 
the homomorphism x '■ G{¥qn) — > Q^. 

We claim that C G C5'(G')^'". and that t^x = X^- First of all, the commutativity 
of G implies that a o (L„ x L„) = Lnoa:GxG^G. Thus a*C is the unique local 
system on G X G such that (L„ x Ln)*a*C is the trivial rank 1 local system on G x G 
equipped with the G(Fgn) x G(Fgn)-equivariant structure given by the character a*x- 
Similarly, (L„ x Ln)*{CMC) is the trivial rank 1 local system on G x G equipped with the 
G(¥qn) X G(Fgn)-equivariant structure given by the character x ^ X- But x^ X = '^*X-i 
and it follows from the fact mentioned in the previous paragraph that a*C = £ lEl £. 

Similarly, it is easy to construct an isomorphism il)n,c '■ (Fr")*/^ C Indeed, L„ com- 
mutes with Fr", so L;(Fr")*/: = (Fr")*L;£ = (Fr")*^^ = = L^C (where denotes 
the constant rank 1 local system on G and all isomorphisms are canonical). Moreover, 
multiplication by G(Fqn) commutes with Fr", which implies that the isomorphisms above 
are in fact isomorphisms of G(Fqn)-equivariant local systems, where is equipped with 
the equivariant structure given by the character x- Thus the isomorphisms above de- 
scend to the desired isomorphism il)n,c '■ (Fr")*£ — ^ C. The last observation is that if 
g e G{¥qn) and 7 G G(F) is such that g = Lni'j), then, by definition, 7 = Fr"'(7) — g, 
whence ipn,c acts as multiplication by x{9)~^ on the stalk Cg. Thus tn^ = x~^- course, 
we can replace x with x~^, a-nd the proof of the lemma is complete. □ 

Lemma 1.11. If C,K, G CS{G)^" and tn,c — tn,K, then £ = /C. 

Proof. In view of the argument used in the proof of the previous lemma, it suffices to show 
that if £ G GS'(G)^", then L*>C is a trivial rank 1 local system on G. (Indeed, it then 
follows that C is determined up to isomorphism by the G(F^n)-equivariant structure on 
L*£, which is given by the character t~£.) Let l : G ^ G denote the inversion map, and 
let A : G ^ G X G denote the diagonal. By definition, L„ = a o (Fr" x /,) o A : G ^ G. 
If £ G GS{G), then a*C^ £, which imphes that L^C ^ ((Fr")*£) ® £-1. If, in 
addition, (Fr")*£ = £, then L*£ is trivial, as desired. □ 
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It is clear that the three lemmas above imply that if G is a connected commutative 
algebraic group over F^, then the collection CS{G) of local systems on G that we have 
defined at the beginning of this subsection satisfies property (4-iii) of §1.4. Thus question 
(4) has an affirmative answer in this case. 

2. The orbit method for finite nilpotent groups 

The orbit method was originally discovered by A.A. Kirillov [Ki62] for connected and 
simply connected real nilpotent Lie groups. In this section we discuss the orbit method 
in a different context of finite nilpotent groups of "small" nilpotcnce class^. In Section 
3 we will apply the orbit method to the groups of the form r„ = G'(Fgn), where G is a 
unipotent algebraic group over whose nilpotence class (defined in §1.1) is less than p. 

For more information about the orbit method for nilpotent Lie groups we refer to [Ki62] 
and [BCD72] (the latter also contains results about more general solvable Lie groups). A 
detailed exposition of the orbit method for finite nilpotent groups appears in [BSx] . 

2.1. Lazard's construction. Fix c G N. Let Nilp^ be the category of (possibly infinite) 
nilpotent groups F of nilpotence class < c such that the map F — > F, i— > g^*^, is invertible 
for all k < c. Let nitp^ be the category of nilpotent Lie algebras over Z[^] of nilpot ence 
class < c. Michel Lazard [Laz54] constructed a canonical isomorphism of categories 
Exp : ni[p(, Nilpp. The functor Exp is defined as follows. The group Expg has the 
same underlying set as the Lie algebra q G t^ilpc) group operation on the set 

Exp = g is defined by the formula 

x*y ■.= '^CHi{x,y), x,y e q, (2.1) 

i<c 

where CHi is the homogeneous component of degree i of the Campbell-Hausdorff series 
CH{X,Y) := log(exp(X)exp(y)). (For instance, CH2{X,Y) = [X,Y]/2.) It is known 
that CHi is a Lie polynomial with coefficients in (by definition, this means that CHi 

belongs to the free Lie algebra over with generators X,Y). So the RHS of (2.1) is 

well defined. It is easy to sec that Exp g is a group of nilpotence class < c, and that if 
/ : 01 ^ 02 is a morphism in nilp^,) then /, viewed as a map Exp0i — > Exp 02, is a group 
homomorphism. So Exp is a functor nilp^ — > Nilp^. 

Theorem 2.1 (M. Lazard). Exp : nilpp Nilp^ is an isomorphism of categories. 

For the proof, see [Laz54] or [Khu98], §10.2. The inverse functor to Exp will be denoted 
by Log. If e nilpc and F = Exp e Nilp^, we prefer to denote the identity maps between 
and F by exp : ^ F and log : F — 0, respectively. Thus our notation is compatible 
with the one used in classical Lie theory. 

'^Thc fact that the orbit method works in this context was probably clear as soon as the original orbit 
method over M was discovered. The usefulness of the orbit method for finite groups was demonstrated 
by D. Kazhdan [Ka77]. 



AN INTRODUCTION TO CHARACTER SHEAVES AND THE ORBIT METHOD 



15 



2.2. Orbit method: formulation. Let F be a finite group of nilpotence class < c 
such that all the prime divisors of the order |r| are greater than c. Applying Lazard's 
construction (see §2.1) we get a finite Lie ring q :— LogF e tiilp^ ^ bijection log : 
r Q. The abelian group 

g*:=Hom(s,C") 

carries a natural action of F, called the coadjoint action. The orbit method in its simplest 
incarnation provides a natural bijection between F and the set g*/F of F-orbits on g*. 

Theorem 2.2. For every T -orbit fi C g* there exists G F whose character is given by 
the formula 

''^^^^^^^ = (cardQ)V2 E/(^"gg) e r. (2.2) 

The map ^— > pn is a bijection g*/F F. 

Remarks 2.3. (i) Formula (2.2) means that the character of equals the (inverse) 
Fourier transform of the characteristic function of up to a constant factor. 

(ii) It follows from (2.2) that 

dimpf^ = (cardQ)^/^. (2.3) 

(iii) By (2.3), cardQ is a full square. There is also a direct proof of this fact (see [BSx]), 
very much in the spirit of the proof of the corresponding well known fact from Lie 
theory: the dimension of any coadjoint orbit for every Lie group is even [Ki62]. 

(iv) As a representation, is defined only up to a non-unique^ isomorphism. However, 
it follows from [LP81] that, given f & fl, there is a way to construct a representation 
Pf with class pn e F which is defined up to a unique isomorphism. 

The proof of Theorem 2.2 given in §§2.3, 2.4 below is well known, but we were unable 
to find it in the hterature. Kirillov's original proof [Ki62] was different. It is longer but 

allows one to construct the irreducible representations of F (not only their characters), 
and it works for nilpotent groups over M. or Qp. His proof is based on the notion of a 
polarization, which will be recalled in §2.5. Some of the references in the literature that 
adapt Kirillov's method to the situation of Theorem 2.2 are [Ka77, Ba86, Ma96, BSx]. 

2.3. Construction of the orbit method bijection. In this subsection we will construct 
a bijection 

SVF ^ F; (2.4) 
in §2.4 we will prove (2.3), and then (2.2). One has 

g*/r = Spec Fun(0*)^, F = Spec ZF, (2.5) 

^If V is the space of the representation pa and Tq = {g G Aut(r) | gQ = O}, then it is not always 
possible to make the projective representation of Ffj in y a true representation. In fact, Fn D T/Z, where 
Z is the center of F, and the projective representation of T/Z in V can be made a true representation 
only if Z n [r,r] C KerpQ. This condition does not hold if F is the Heisenberg group and cardQ > 1. 
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where Fun(g*) is the algebra of functions 0* — > C with pointwise multiphcation, and ZF 
is the center of the group algebra CF of F. Note that CF is naturally isomorphic to 
the algebra Meas(F) of complex measures on F with convolution as the multiplication 
operation, and under this isomorphism ZF corresponds to the subalgebra Meas(F)'" C 
Meas(F) of measures invariant under conjugation. The Fourier transform provides a F- 
equivariant isomorphism of algebras 

T : Meas(0) ^ Fun(0*), 

so constructing (2.4) amounts to constructing an algebra isomorphism 

Meas(0)^ ^ Meas(F)^. (2.6) 

The bijection exp : g ^ F induces an isomorphism of vector spaces 

exp, : Meas(0) ^ Meas(F). (2.7) 

We define (2.6) to be the restriction of (2.7). Notice that if F is not commutative, then 
exp : — > F is not a group homomorphism, and therefore (2.7) is not an algebra morphism. 

Proposition 2.4. The map (2.6) we have defined is an isomorphism of algebras. 

A complete proof of this proposition is contained in [BSx]. It rests on Lemma 2.5 below. 
We leave the proof of Proposition 2.4 as an exercise for the reader (it can be easily done 
by imitating the proof of Proposition 5.11). 

Lemma 2.5. For every c G N, there exist Lie polynomials (f){X,Y) and ip{X,Y) with 
coefficients in TL [g] such that 

log(exp(X) • exp(r)) = exp(ad0(X, Y)) {X) + exp(ad V^(X, F)) (Y) (2.8) 

modulo terms of degree > c + 1 . 

(The statement means that (f){X, Y) and il^{X, Y) are elements of the free Lie algebra over 
Z [g] generated by X and Y, and that the difference between the two sides of (2.8) is 
a formal Lie scries in X and Y all of whose terms have degree > c + 1. Note that if 
g G nitp^, then 0(,t, y) and ip^x, y) can be evaluated in g for all x,y E g.) 

Sketch of the proof. One can construct and ip inductively. Let us write 0(X, Y) = 
Yl'n^i4>n{^,y) and ip{X,Y) = Yl,'n=^i'4^n{^,y), whcrc (pn and ipn are homogeneous Lie 
polynomials of degree n. Then at each step of the induction, we will have to solve an 
equation of the form [X, 0„] + [Y, ipn] = rjn+i{X, Y) modulo commutators of order > n + 2, 
where r]n+i{X,Y) is already known. It is easy to check that this is always possible. As 
the proof shows, we use nothing special about the Campbell-Hausdorff series: as a matter 
of fact, the latter could be replaced by any formal Lie series whose linear part is X + Y 
and whose terms of degree < c have coefficients in Z [^] . □ 
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Proposition 2.4 means that the composition 

$ : Cr ^ Meas(r) ^ Meas(0) Fun(0*) (2.9) 

restricts to an algebra isomorphism ZF Fun(0*)'". In view of (2.5), this yields a 

bijection 0*/F — ^ F, as desired. This bijection will be denoted by 17 i— p^. We warn the 
reader that in general, the composition (2.9) is not an isomorphism of ZT -modules, where 
the ZF-module structure on Fun(g*) is induced by the isomorphism ZF Fun(g*)^ (see 
Appendix H for a counterexample). 

Remark 2.6. The composition (2.9) takes the central idempotent en G ZF corresponding 
to the representation po to the characteristic function 1^ of the subset Q C g*. 

2.4. Proof of the character formula. Let Xreg '■ CF C denote the character of the 
regular representation of F, and $ : CF Fun(g*) the composition (2.9). 

Lemma 2.7. We have Xreg = S o where E : Fun(5*) C takes f e Fun{Q*) to 

Proof. Wehavexreg(l) = cardF = (So$)(l). If 7 g F\{1}, then Xreg(7) = 0= (So$)(7). 
Since Xreg and E o $ are linear, the proof is complete. □ 

Let en and pn be as in Remark 2.6. Then Xregi^n) = (dimpn)^. Combining this with 
Lemma 2.7 and Remark 2.6, we obtain (dimp^)^ = S(1q) = cardJl, which is equivalent 
to (2.3). To prove (2.2), notice that the character of pn, call it xn '■ — > C, is the hnear 
functional invariant under F-conjugation whose value at e^' equals trpn(en'); i-e., dimpj^ 
ifn' = Q and if Q' Q. By Remark 2.6, Xn = ino where in ■ Fun(0*) ^ C is the 
F-invariant linear functional such that = for fi' 7^ and £n(ln) = dimpn — 

(cardQ)V2. This is equivalent to (2.2). 

2.5. Polarizations. To end the section we briefly explain a different approach to the orbit 
method which has the advantage of explicitly constructing irreducible representations, not 
only their characters. Furthermore, this approach works not only in the setting of this 
section, but also in the setting of nilpotent Lie groups [Ki62]. 

Definition 2.8. (i) Let g be a nilpotent Lie algebra over a field k and f e g* — 
Homfc(g, k). A polarization of g at / is a Lie subalgebra f) C g such that /([^, f)]) = 
{0}, and [) is maximal among all subspaces of Q with this property, 
(ii) If is a finite nilpotent Lie ring and / e 5* = Homz(0, C^), a polarization of g at / 
is a Lie subring I) Q Q such that /([f),f)]) = {!}, and f) is maximal among all additive 
subgroups of Q with this property. 

Theorem 2.9. In each of the situations (i) and (ii), g has a polarization at every f e g* . 

This theorem is due to A. A. Kirillov [Ki62], and a somewhat different proof was given 
by M. Vergne [Ver70]. We explain her proof in Appendix D. 
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Remark 2.10. The theorem imphes that one can alternately define a polarization to be 
a subalgebra f) C g of maximal possible dimension satisfying = 0; this is the 

approach of [Ki62]. On the other hand, it is not true that a maximal (with respect to 
inclusion) subalgebra f) C g satisfying /([(),()]) = is necessarily a polarization: see §H.2. 

The following theorem, due to A. A. Kirillov [Ki62] , explains how to construct an irre- 
ducible representation corresponding to a given coadjoint orbit. 

Theorem 2.11. In the situation of Theorem 2.2, let f & ft, and leti) C. g be a polarization 
at f . Put H = Exp f), and let Xf '■ H ^ be the character corresponding to f . Then 
the representation pf^^ :— Ind^x/ is irreducible, and its isomorphism class equals pq. 

For a proof of this result and for more details we refer the reader to [BSx] . 

3. Unipotent groups over and L-indistinguishability 

In this section we apply the orbit method discussed above to study the elementary 
questions posed in §1.3 for unipotent groups of small nilpotence class. 

3.1. LciZcird's construction for unipotent groups. Let k he a, field of characteristic 

p > 0, and let G be a unipotent algebraic group over k which has nilpotence class < p — 1. 
For every scheme S over k, we get the (possibly infinite) group G{S) that satisfies the 
assumptions of Theorem 2.1 with c = p — 1, and hence Lazard's construction produces 
a Lie ring g{S) (in fact, a Lie algebra over ^[(^ziyy])- Thus we get a functor g from 
schemes over k to Lie rings, and this functor is obviously representable since the functors 
{A;-schemes} — > {Sets} corresponding to G and g are the same by definition. Hence g 
is a Lie ring scheme over k. Moreover, the underlying additive group of g is unipotent, 
because G has a filtration by normal subgroups with commutative unipotent successive 
quotients, which induces a similar filtration on the additive group of g. We will write 
g = LogG. Conversely, if we start with a nilpotent Lie ring scheme g over k such that the 
underlying additive group of g is unipotent and the nilpotence class of g is less than p, 
we can form the associated unipotent group scheme G = Expg. These two constructions 
will also be referred to as Lazard's constructions. 

Remark 3.1. All of the above goes through equally well in the case when charfc = 0. 
In this situation no assumption on the nilpotence class of G or g is needed. However, 
Lazard's construction is not very useful in this case because the Lie ring scheme g it 
produces always arises from an honest nilpotent Lie algebra over k, which coincides with 
the Lie algebra of the algebraic group G in the classical sense. On the other hand, it is 
very important to notice that if char k > 0, then Log G may be very different from the Lie 
algebra of G, even if G is annihilated by p. An example is provided by the fake Heisenberg 
groups defined in §3.7, for which LogG does not correspond to any Lie algebra over k. 
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3.2. The dual of q. Now let us assume that k is perfect and G is connected (this 
imphes that G is geometrically connected, see the footnote to Proposition 1.4). Then g 
is connected, so one has its Serre dual g* as an object of the category Ck from §1.7.^ The 
general definition of Q* is given in Appendix F, but the reader may prefer to assume that 
p- Q = 0, and to use the ad hoc definition of q* from §1.7 (all phenomena discussed in this 
article already appear in this special case). 

In some sense, one also has the coadjoint action of G on g*. More precisely, the situation 
is as follows. Recall that the category Ck in which g* lives is a certain localization of the 
category Ck of connected commutative unipotent algebraic groups over k, and there is 
no canonical way of choosing a representative of g* in Ck- Thus, strictly speaking, one 
should denote such a representative by a different symbol, such as g', as we have done 
in Appendices F and G. Furthermore, in Corollary F.6 we show that there exists a 
representative g' e Ck of g* and an action of G on g' by group automorphisms which 
induces the canonical action on g*. However, in the main body of the paper we will 
denote by g* a chosen representative of the Serre dual of g on which G acts. 

A simple and instructive example of a coadjoint action will be discussed in §3.7. 

3.3. The orbit method for unipotent groups. From now on assume that k — ¥q, 
so (j is a connected unipotent algebraic group over of nilpotence class < p. Fix a 
representative g* G Ck of the Serre dual of g = LogG so that G acts on g* (see §3.2). 

Let us consider questions (l)-(3) from §1.3 in this situation. The answer to question 
(1) is positive. Indeed, the base change maps 

can be defined as follows. By Proposition F.2, we have natural identifications g*{¥qn) = 
g{¥qn)* for all n e N. We define (3.1) to be the composition 

r„. = 0*(F,-n)/r^ 0*(F,„)/r„ = r,. 

Here the arrow is induced by the inclusion g*{¥qm) ^ g*{¥qn) and the equalities stand 
for the natural bijections provided by the orbit method. The map (3.1) is clearly Fr- 
equivariant. The set F := limF^ is naturally identified with g*{¥)/G{¥). 

n 

Now consider question (3) from §1.3. It amounts to whether 0*(F)/G'(F) can be inter- 
preted as the set of F-points of some kind of geometric object over ¥q. We do not know a 
good answer^". But at least, there exists a stratification of g* by G-invariant locally closed 

is disconnected, then g* is not a group scheme, but rather a Picard stack. 
■'■'^Here is an answer that has a chance to be good. If X is a G-scheme of finite type over a field k 
one can define X/G as an h-sheaf, i.e., as a sheaf on the category of fc-schemes of finite type equipped 
with Voevodsky's h-topology (sec the appendix to [SV96]). Namely, X/G is the /i-shcaf associated to the 
presheaf S X{S)/G{S). This definition of X/G seems to be reasonable at least if the stabilizers of all 
points of X have the same dimension. 



20 



M. BOYARCHENKO AND V. DRINFELD 



subschemes Sr such that for each r the subscheme {{g,s) G G x Sr\gs = s} is flat over 
Sr'-i then the quotient Sr/G exists as an algebraic space and {Sr/G){¥) — 5'r(F)/G(F). 

3.4. The L-indistinguishability phenomenon. Let G be as in §3.3. We wiU show 
that in general, the answer to question (2) from §1.3 is negative: in terms of Definition 
1.1, there may exist L-packets with more than one element. We will also describe the 
L-packets (see Proposition 3.3(iii) and Remark 3.4). 

Proposition 3.2. The Tfiaps Fjj — > (r) ( / 9 ) ^j,g surjective. They are injective for 
all n if and only if the G-stabilizer of each point of g* is connected. 

In §3.7 we will give an example where the stabilizers of some points of Q* are dis- 
connected. Proposition 3.2 is a consequence of the discussion in §3.3 and of statements 
(i)-(ii) of the following proposition applied to X = q*. Statement (iii) for X = q* gives a 
description of L-packets. 

Proposition 3.3. Let X be an algebraic variety over ¥q equipped with an action of a 

connected algebraic group G. 

(i) The natural map 

f : X{¥,)/G{¥,) {X{¥)/G{¥)f (3.2) 

is surjective. 

(a) The map X{¥qn)/G{¥qn) X(¥)/G(¥) is injective for each n if and only if the 

G-stabilizer of each point of X is connected. 
(Hi) For each x e X(¥q) there is a canonical bijection f~^{f{x)) H^{¥q,7ro{Gx)). 
Here Gx C G is the stabilizer of x, Tro{Gx) '■— Gx/G°, x is the image of x in 
X{¥q)/G{¥q), and G° is the connected component of the identity in G^- 

This proposition is standard. Its proof will be recalled in §3.8. In the next subsection 
we describe a class of connected unipotent groups for which all L-packets are trivial. 

Remark 3.4 (A gerby description of the L-packets). A drawback of the description of the 
fiber f^^{f{x)) given in Proposition 3.3(iii) is that it depends on the choice of x, not only 
on y = fix). However, there exists a more canonical description. Namely, let us first 
consider the groupoid whose set of objects is {xq G X{¥q)\f{'x^) = y} and where a 
morphism xq — > Xi is an F^-point of no(^{g e G | gxo — Xi}). By Lang's theorem (applied 
to the neutral component G°^ of Gx:q) such an Fg-point can be lifted to an F^-point of 
l^f G G I gxQ = xi}. Thus the isomorphism classes of objects of are in one-to-one 
correspondence with the elements of f^^{y). 

The groupoid '^y can in turn be described in terms of another groupoid ^ whose set 
of objects is {xq G X(Fg)|/(a^) = y} and where a morphism xq — >• Xi is an F-point of 
7ro({5' G G I gxQ = XiY). Note that is a gerbe over a point (i.e., a gerbe over F). That 
is, s^y has precisely one isomorphism class of objects. Moreover, s^y is equipped with a 
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(strict) action of Fr, and '^y can be identified with the groupoid of pairs (c, Fr(c) — ^ c) 
consisting of an object c of ^ and as isomorphism between Fr(c) and c. 

3.5. Groups of exponential type. If g is an honest Lie algebra (as opposed to a Lie ring 
scheme) over of nilpotence class < p, then the unipotent algebraic group G = Expg 
produced by Lazard's construction is said to be of exponential type. In this case one can 
choose the group scheme g* from §§3.2-3.4 to be equal to the vector space dual to Q. 

Proposition 3.5. Let G be an algebraic group over ¥q of exponential type. Then 

(i) the G -stabilizer of every / e g* is connected, 
(a) all G-orbits in Q* have even dimension. 

Proof. The stabihzer of / e g* equals Expg-'', where is the set of all x e g such that 
f{[x, y]) — for all y G g. Clearly g-^ is a linear subspace of g, so G^ is connected. As g-^ 
is the kernel of the alternating form f{[x,y]), its codimension is even. □ 

3.6. Functional dimension. Let p be an irreducible representation of G{¥q) and Q C 
g*(Fg) the corresponding G'(F^)-orbit. 

Definition 3.6. The functional dimension of p is 

fdim p — - ■ dim(GO) , 
where GQ is the orbit of the algebraic group G containing Q. 

Remarks 3.7. (i) If G has exponential type then by Proposition 3.5(ii), the functional 
dimension of any p is an integer. But in general, as was first observed by Lusztig 
[Lu03], the functional dimension may fail to be an integer (see §7.9). 

(ii) The name "functional dimension" is traditional in the representation theory of real 
nilpotent Lie groups. In this setting it is an integer, and an irreducible representation 
of functional dimension n can be realized in the space of sections of a vector bundle 
on an n-dimensional variety. 

3.7. The fake Heisenberg groups. In this section we study the simplest example of a 
noncommutative connected unipotent group in positive characteristic. We define a fake 
Heisenberg group over a perfect field k to be any unipotent algebraic group G over k of 
exponent p = char k that can be represented as a noncommutative central extension 

^ G„ ^ G ^ G„ ^ 0. 

The existence of such groups is purely a characteristic p phenomenon. Indeed, in char- 
acteristic zero, every extension of Ga by Ga splits (this follows from the corresponding 
statement for Lie algebras). In characteristic p, however, there are plenty of examples. 
The name "fake Heisenberg group" is motivated by the fact that in characteristic the 
smallest noncommutative unipotent group is the Heisenberg group (it has dimension 3). 
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It is a little easier to understand the corresponding Lie ring schemes. Since a fake 
Heisenberg group always has nilpotence class 2, we assume in this section that p > 2. 
Let G be a fake Heisenberg group as above, and let q = LogG, defined via Lazard's 
constructions. Then, as an additive group, g is an extension of by G^. This extension 
is split because by assumption, G (and hence q) has exponent p, and k is perfect. Thus we 
only need to specify the Lie bracket on q, which corresponds to a choice of an alternating 
bi-additive morphism 

B:GaXGa — > Ga. 
Such morphisms are exactly the ones of the form 

B{x,y) = ^aijxP'yP^, 

where a^- e k satisfy Uij — —aji. 

Let us now assume that k = ¥q and concentrate on the simplest example: B(x,y) — 
x^y — xyP. Let G denote the corresponding fake Heisenberg group. Using the Campbell- 
HausdorfT formula, which is very simple for groups of class 2, we see that G = as a 
variety over k, with the group law 

{x, z)-{y,w)^ (x + y,z + w + ^{x^y - xy^j^ . 

Let us also fix, once and for all, a nontrivial additive character : Fp — >■ C^. As explained 
in Example 1.6 (we remind the reader that in Section 1 we have used the notation q in 
place of 0*), this choice allows us to identify g* with Ga ® Ga, using the pairings 

(•, •> : (G„(F,n) e Ga{¥gn)) X (G„(F,n) e Ga(¥gn)) C^ 

{{u,v),{y,w)) = (trF^„ (uy + vw)). 
The adjoint action of G on g is easy to compute: given (x, z) G G, we have 

Ad(x, z) : g^g, (y, w) i — > {y,w + x^y - xy^) . 
We leave it as an exercise to the reader to compute the coadjoint action (use Remark 1.7): 
Ad*(x, z):g* ^g\ {u, v)^ {u + x^'^v^'^ - x^v, v). 

This provides a concrete explanation of why the functor defining the Serre dual g* of the 
underlying commutative unipotent group of g is not representable on the category of all 
affine A;-schemes. Indeed, if it were representable, then the coadjoint action G x g* ^ g* 
would be defined as a morphism of /c-schemes, while the presence of x^^^ in the equation 
above shows that it cannot possibly be defined unless one replaces G with its perfectization 
(this notion is defined in §F.l). 

Remark 3.8. On the other hand, the operation of passing from G to its perfectization 
changes neither the group of points over F, nor the (Zariski or etale) topology of the 
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underlying scheme. In particular, it is irrelevant for the construction of irreducible char- 
acters of the groups G{¥qn), and also for the theory of character sheaves, since perverse 
sheaves are topological objects. 

We also obtain an example of a situation with nontrivial L-packets. Namely, it is 
easy to check that the stabilizer in G of a point {u, v) G g* is defined by the equation 
_ x^v = (where {x,z) are the coordinates on G), or, equivalently, = xv. 

In particular, if v 7^ 0, we see that the stabilizer of {u, v) is not connected. Moreover, 
it is easy to see that the Lang isogeny may fail to be surjective for the stabilizer in this 
case. Proposition 3.3(ni) now implies that there exist different G(Fg)-orbits in 0*(Fg) that 
become the same orbit over F. 

Finally, observe that the nontrivial G-orbits in g* have dimension 1. Thus the example 
of fake Hcisenberg groups is very important, because it is elementary, and yet illustrates 
all three phenomena mentioned at the beginning of the introduction. 

3.8. Proof of Proposition 3.3. The proof will appear in the final version of the text. 
(It is completely straightforward.) 

4. Character sheaves in the orbit method setting 

4.1. Construction of character sheaves. Let k be an algebraically closed field of char- 
acteristic p > 0, and let G be a connected unipotcnt algebraic group over k whose nilpo- 
tence class is < p — 1. We use the notation and constructions of §§3.1, 3.2. Thus we have 
the Lie ring scheme Q — Log G, and we can choose a representative Q* e Ck of the Serre 
dual of Q such that G acts on q*. Since G is unipotcnt and the underlying variety of g* 
is affine, it is well known that all orbits of the G-action on g* are closed. If ^2 C g* is 
such an orbit and C is an irreducible local system on Q, it follows that the £-adic complex 
(see §E.l) on g* given by iQ*(£)[dimr2], where ia : ^ ^ g* denotes the inclusion, is an 
irreducible perverse sheaf on g* (see §G.2). 

Definition 4.1. The character sheaves for the group G are the ^-adic complexes on G of 
the form exp^ ^~^(in*(>C)[dimQ]) for an irreducible G-equivariant local system £ on a 
G-orbit f2 C g*, where exp : g — > G is the exponential morphism and J- : D^[q, Qg) — > 
Dc{Q*,Qe) is the Fourier-Dclignc transform. If Q is fixed, the corresponding character 
sheaves are said to lie in the L-packet defined by Q. All L-packets are finite (see below). 

Remarks 4.2. (a) The Fourier- Deligne transform^^ for i-adic complexes, which is an ana- 
logue of the classical Fourier transform for functions, is discussed in Appendix G. It 
is an equivalence of triangulated categories which takes perverse sheaves to perverse 
sheaves. Thus the character sheaves for G are irreducible perverse sheaves. 

-"^^Strictly speaking, in order to define the Fourier-Deligne transform one has to choose an isomorphism 

between Qp/Zp and the subgroup /ipoo c Qf of roots of unity whose order is a power of p. However, this 
choice is not important for us, so throughout this paper we assume that one such choice has been made 
once and for all, and we speak of "the" Fourier-Deligne transform. 
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(b) The general definition of G-equivariant local systems or £-adic complexes is recalled 
in §H.3. We note that since G is connected, being equivariant is a property of an 
irreducible local system, rather than extra structure. More precisely, any two G- 
equivariant structures on an irreducible local system C onVl are proportional to each 
other. Furthermore, the notion of irreducibility is unambiguous, in the sense that 
if £ is a G-equivariant local system which has no nontrivial G-equivariant sub-local 
systems, then it is also irreducible as an ordinary local system. 

(c) The definition above is motivated by the classical orbit method. Indeed, irreducible 
perverse sheaves on g* of the form if2*(>C)[dimO] are natural analogues of the charac- 
teristic functions of coadjoint orbits in the setting of Section 2. The main difference 
with the classical setting is that there may exist nontrivial irreducible G-equivariant 
local systems on coadjoint orbits Q C g*. More precisely, if a; G and Tlx = Gx/G% 
is the group of connected components of the stabilizer of x in G, then the category of 
G-equivariant local systems on Vt is equivalent to the category of finite dimensional 
representations of Hx over Q^. As we have already observed in the pervious section, 
Hx may be nontrivial. We also see that the L-packet defined by Q, can be identified 
with the set Hx] in particular, it is finite. 

4.2. Relation to irreducible chciracters. The main result of this section is 

Theorem 4.3. Let Gq be a connected unipotent group over ¥q whose nilpotence class is 

< p — 1, let G = Go (E)Wg ¥, let Ft = (E) 1 : G ^ G denote the Frohenius morphism, and 
let GS{G) denote the collection of character sheaves for G constructed in Definition 4-i- 

(a) Each L-packet for G consists of 1 element if and only if the stabilizer of every point 

of g* in G is connected, 
{b) If all stabilizers of points of Q* in G are connected, then GS{G) satisfies properties 

{4-i)-{4-m) i'lT' thus the answer to question {4) is affirmative in this case. 
(c) In general, GS{G) satisfies the weaker property stated at the end of ^1.4- 

The proof will appear in the final version of the text. It is not difficult to deduce this 
theorem from the orbit method for finite nilpotent groups explained in Section 2 and the 
results of Appendix A. 

5. Character sheaves for general unipotent groups 

In this section we formulate a general definition of character sheaves for a unipotent 
group G over an algebraically closed field k of characteristic p > 0, and explain why it 
agrees with the ad hoc definition given in the previous section when G is connected and 
has nilpotence class < p. We will use some results on idempotents in monoidal categories; 
for their proofs and many more details we refer the reader to [BDx] . 

5.1. Idempotents in monoidal categories, li Ai = {Ai, ®, 1) is a monoidal category, 
where <^ : M.xJ\4 — > M. is the monoidal bifunctor and 1 is the unit object, we define an 
arrow 1 — > e in Al to be an idempotent arrow if it becomes an isomorphism after tensoring 
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with e either on the left or on the right. An object e of Ai will be called an idempotent 
if there exists an idempotent arrow 1 — > e. This notion is rather rigid: for example, if 
711,712 : 1 ^ e are two idempotent arrows, then there exists a unique morphism / : e — > e 
satisfying / o tti = 7r2. By symmetry, / is then necessarily an isomorphism. 

Remark 5.1. For the sake of brevity, our terminology here differs from that of [BDx]. 
Namely, what wc call an idempotent here is referred to as a closed idempotent in op. cit.. 
The motivation for the terminology is also explained in op. cit. 

We define a partial order on the set of isomorphism classes of idempotents in 7W as 
follows: e < e' whenever e e' = e. One can show that this condition is equivalent to 
e' e = e; this order relation can also be characterized in many other ways, see [BDx]. 

5.2. Important remcirk. The notion of an idempotent in fact depends only on the 
bifunctor (8) and not on any other ingredients of a monoidal category, i.e., the associativity 

constraint and the unit object. Indeed, the associativity constraint does not appear in 
the definition, and since any two unit objects arc isomorphic, it is easy to see that e E A4 
is an idempotent with respect to one unit object if and only if it is an idempotent with 
respect to every unit object. Similarly, the partial order relation on the set of isomorphism 
classes of idempotents in A4 introduced above also depends only on (8), which is obvious 
from the definition. 

5.3. Hecke subcategories. Let be a monoidal category. If e is an idempotent in 
Ai, we define cAi to be the full subcategory of Ai consisting of objects isomorphic to 
those of the form e ® X, where X e Ai. It is easy to see that eA4 consists precisely 
of those Y e M for which e ®Y Y. The full subcategories M.e and eMe of A4 are 
defined similarly. We call eA4e the Hecke subcategory associated to the idempotent e. It 
is closed under (g), which makes it a monoidal category with unit object e. If is a 
braided monoidal category (BMC) or, more generally, ifX®Y = Y®X for any pair of 
objects X,Y of Ai (we do not even need these isomorphisms to be functorial), it is clear 
that the three subcategories eAi, Aie and eAie all coincide. 

5.4. Minimal idempotents. Let M. be an additive monoidal category (this means that 
Ai is an additive category equipped with a monoidal structure such that the bifunctor 
® is biadditive). We define a minimal idempotent in At to be an idempotent which is 
minimal in the set of nonzero idempotents in Ai with respect to the partial order relation 
introduced in §5.1. If is a braided monoidal category and e, e' are idempotents in A4, 
one can prove [BDx] that e (8) e' is again an idempotent. This has the consequence that if 
Ai is an additive BMC and ei, 62 are minimal non-isomorphic idempotents in Ai, then 
ei (g) 62 0. Consequently, eiM fl 62 A< = = (ciM) ^ {e2M). 

5.5. The categories ^(G) and ^ciG)- Let k be an algebraically closed field of char- 
acteristic p > 0, and G a unipotcnt algebraic group over k. We also fix a prime i ^ p. 
The category ^{G) = D'^{G,Q^) of constructible £-adic complexes on G is discussed in 
§E.l. It is a monoidal category with respect to the convolution operation defined below 
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(see also §E.5). The category &g{G) of G-equivariant objects in ^(G), where G acts on 
itself by conjugation, is defined in §E.6. It is also a monoidal category with respect to 
convolution, and, moreover, it is naturally braided (see below). We have the forgetful 
functor &g{G) — > &{G) by means of which every object of &g{G) can be thought of as 
an £-adic complex on G. If G is connected, this functor is fully faithful (see §E.7). 

The convolution bifunctor on 2i{G) and ^g(G') is defined by 

M *N ^ li,{MMN), 

where /x : G x G — > G is the multiplication morphism. The unit object 1 in ^{G) or in 
^g{G) equals the delta-sheaf UQ^ = liQ^, where 1 : Spec/c — * G is the unit of G. 

The monoidal category ^g{G) has a natural structure of braided category. The braiding 
/3m,n ■ M * N N * M is defined as follows. Consider the commutative diagram 

G X G— ^G X G 



G X G G, 

where T{g,h) := {h,g) and ^{g,h) := (g,g~^hg). We have M * N = fi\{M M N), and 
the above diagram shows that N * M = {fJ.r)i{M ^ N) = fii^i{M ^ N). We define 
I3m,n ■■ l^\{M MN) ^ i^SiM m N) by I3m,n ■= /^!(/), where f : M m N ^ ^^{M M N) 
comes from the G-equi variant structure on N. 

Another important structure on ^g{G) is the canonical automorphism of the identity 
functor, defined as follows. Let p2 : GxG ^ G denote the second projection, c : GxG ^ 
G the conjugation action morphism c{g, h) = ghg^^, and A : G — G x G the diagonal. 
Then c o A = id^ = p2 o A. For each M G ^g{G), the G-equivariant structure on M 
yields an isomorphism c*M — > P2M] pulling it back by A, we obtain an isomorphism 
9m '■ M M, called the canonical automorphism of M. It is clear that the collection 
of all the ^m's defines an automorphism of the identity functor Id : ^(^(G) — > ^g{G). 
It is related to the braiding via the easily verified formula 

Om*n = Pn,m o (3m,n o (^m * ^jv) V M, N,e^G(G). 

5.6. General definition of chciracter sheaves. For every minimal idempotent e e 
^g(G), we let tVI^^™ c eS>G{G) denote the full subcategory consisting of those complexes 
in e&G{G) that are perverse sheaves on G. Let us also recall that eS^ciG) — S>G{G)e — 
e^(3(G)e, because S^GiG) is braided. 

Definition 5.2. A character sheaf on G is an indecomposable object of the category ^Vf^*^™ 
for some minimal idempotent e G &g{G)- The collection of isomorphism classes of all 
character sheaves on G will be denoted by GS{G). If e G &g{G) is a minimal idempotent, 
the set of isomorphism classes of character sheaves in eS^oiG) will be called the L-packet 
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associated to e. An L-packet is said to be trivial if it consist of only one element. Character 
sheaves that belong to the same L-packet are said to be L -indistinguishable. 

Remarks 5.3. (1) The subcategory TW^"^™ of ^g{G) is closed under taking direct sum- 
mands. Thus the notion of an indecomposable object of A4^^™ is unambiguous. 

(2) A character sheaf determines the corresponding minimal idempotent e uniquely, be- 
cause of the remark in §5.4. Thus different L-packets are disjoint. 

5.7. Conjectural properties. We now state several conjectures about character sheaves 
which we expect to hold for general unipotent groups (regardless of their nilpotence class). 
We also introduce the notion of functional dimension for a character sheaf that agrees with 
the geometric notion of functional dimension whenever the orbit method is applicable. 

Conjecture 1. (a) For every minimal idempotent e e ^g{G), there exists a number 
Ue e {0, 1, . . . ,dimG} such thafD^e = e[—2ne], where we set = Dcot* = l*oI])g, 
i : G — > G being the inversion map. 

{b) The complex e[— ng] {where we forget the G-equivariant structure on e) is a perverse 
sheaf on G {see %G.2 for the definition of perverse sheaves). 

Definition 5.4. Assuming that Conjecture 1 holds, the number rfg = f is called the 
functional dimension of e. Note that it may fail to be an integer. We also call d^. the 
functional dimension of every character sheaf in the L-packet defined by e. 

Conjecture 2. (a) Character sheaves are irreducible perverse sheaves. 

{b) The triangulated subcategory e&G{G) C &g{G) is generated by A^^"^™. 

(c) We have Ext^^(g)(Mi, M2) = for i > and any two character sheaves Mi, M2. 

{d) All L-packets for G are finite. 

Corollciry 5.5. Assuming that Conjecture 2 holds, M.p^'^'" is a semisimple abelian category 
with finitely many isomorphism classes of irreducible objects, and its bounded derived 
category is naturally equivalent to eS>G{G). 

Conjecture 3. (a) The subcategory Me ■— M'^'^''~'"[ne] C e^G{G) is closed under convo- 
lution, and is thus a monoidal category with unit object e {if Conjecture l{b) holds), 
{b) The monoidal category Me is rigid, and M* = (D^M)[2ne] for M e Me- 
(c) Me is a modular category, where the ribbon structure, or, equivalently, the "twist" , is 
given by the restriction of the canonical automorphism 6 to Me- 

Conjecture 4. If an L-packet for G is trivial, the functional dimension of the corre- 
sponding minimal idempotent e e S>g{G) is an integer. 

Remark 5.6. If Conjecture 1(b) holds, and e e ^g{G) is a minimal idempotent corre- 
sponding to a trivial L-packet, then this L-packet consists of the complex e[— rig]. 

Definition 5.7. An algebraic group H over k is easy if each h e H{k) lies in the neutral 
connected component of its centralizer. 
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Note that this definition makes sense for any algebraic group over any field. In partic- 
ular, it makes sense for reductive groups. 

Conjecture 5. The group G as above is easy if and only if all L -packets for G are trivial. 

The last two conjectures are concerned with the relationship between character sheaves 
and irreducible characters. Thus we now assume that our ground field is A; = F, an 
algebraic closure of a field with p elements, and that G — Gq ®f<, F for a unipotent group 
Go over F^. We have the corresponding Frobenius morphism Fr : G — > G (see §1.4). 

Conjecture 6. Suppose G is connected and all L -packets for G are trivial. Lets e ^g{G) 
be a minimal idempotent such that Fr* e = e, let ipf. : Fr* e e he the unique isomorphism 
such that ipe o Fr*(7r) = vr for some, and hence for every, idempotent arrow vr : 1 — > e, 
and let tf. : GQ{¥q) — > denote the corresponding trace function, as in §i.^. Then 
the function Xe — q'^'''^""'te is an irreducible character of Go{¥q), and every irreducible 
character o/Go(Fg) has this form. Moreover, Xe(l) = q'^"- 

Remarks 5.8. (a) We remind the reader that 1 denotes the delta-sheaf at the identity 
element of G, which is a unit object in the monoidal category ^g{G). 

(b) One can prove the existence of an isomorphism tpe with the property stated above 
using the results of [BDx]; the details will appear elsewhere. 

(c) In the situation of Conjecture 6, we obtain an affirmative answer to question (4) 
in §1.4, at least up to cohomological shift, as in §1.8. Namely, for every minimal 
idempotent e G ^g{G) such that (Fr")*e = e, let ipn,e : (Fr"')*e e denote the 
isomorphism as in the statement of the conjecture, let V^^g ~ qn(de+ne) . ^^^^^ and 
let t[j g : Go(Fgn) — > denote the trace function corresponding to ■^^ g. It is easy 
to check that ■^^g is induced by ■^^g whenever n\k, and, moreover, it follows from 
Conjecture 6 that the functions t'^ ,, are precisely the irreducible characters of Go(Fgn). 

CoroIIciry 5.9. In the situation above, assume that G is easy. If Conjectures 4, 5 and 6 
hold, then the dimension of every irreducible representation ofGo{¥q) is a power of q. 

This statement is obvious. However, as we have already shown in §7.9, the answer to 
question (4) in §1.4 is negative in general. However, we still expect that the following 

weaker statement is true. 

Conjecture 7. Let Gq he any connected unipotent group over F^, and let G = Gq F 
and Fr : G — > G be as above. Let CS{G)^ denote the set of those M G CS{G) for 
which Fr* M = M , and for each such M, choose an isomorphism i/jm '■ Fr* M M , 
and let tu '■ G'o(Fq) — > denote the corresponding trace function. Then the functions 
{^M}J^^g(-.^(g-)Fr form a basis for the space of class functions on G'o(Fg). 

5.8. Chciracter sheaves and the orbit method. In this subsection we prove 

Theorem 5.10. Let G be a connected unipotent group over an algebraically closed field 
k of characteristic p > 0, whose nilpotence class is < p — 1. 
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(a) There is a natural hijection between {isomorphism classes of) minimal idempotents in 
S>g{G) and G-orhits in g* . If e & ^g(G) corresponds to (Z g* under this hijection, 
then ng is the codimension of Q in g* and d^ = |dimf2. 

(b) The notions of character sheaves and L-packets for G provided by Definitions 4-1 and 
5.2 coincide. 

(c) Conjectures 1, 2, 3{a) and 3{b) hold in this situation. 

The proof of this theorem is based on the following 

Proposition 5.11. Every choice of Lie polynomials (f){X,Y) and iIj{X,Y) satisfying the 
conditions of Lemma 2.5 with c = p — 1 determines a collection of isomorphisms 

exp*(M *N)^ exp*(M) * ex.p*{N) WM,N e ^g{G) (5.1) 

that are bifunctorial with respect to M and N. 

Proof. We first reformulate the result entirely in terms of the category ^aig)- Let us write 
Pi,P2 '■ gx g — ^ g for the two projections, a : gx g — > g for the addition morphism, and 
CH : X — g for the morphism defined by {x, y) ^ Xir=i CHi{x, y), where CH{X, Y) 
is the Campbell-Hausdorff series. Then G is exactly g equipped with the operation CH. 
Thus we now obtain two bifunctors on ^^(g), defined by 

M * N = ai{plM (g) pIN) and M-kN = CH,{plM ® p^N). 

The first is the usual convolution of complexes on g, the second one corresponds to the 
convolution of complexes on G. We must prove that every choice of and ip as in Lemma 
2.5 yields an isomorphism of bifunctors between * and -A"- 

Lemma 5.12. The morphism 

h:gxg^gxg, {x,y)^ {e^^^^^y\x),e^'f^^'y\y)), 

is an isomorphism of schemes. 

Proof. It suffices to check that in the situation of Lemma 2.5, the map h : g' xg' — > g' x g' 

defined by the formula above is bijcctivc for every g' G nilp^.. The functor nitp^ — > Sets 
defined by g' ^ g' x g' is (co)representable by the free nilpotent algebra over of 
class c with generators x, y, i.e., Hom(g^, g') = g' x g' for any g' G nitp^. The map h comes 
from an endomorphism of This endomorphism induces the identity on so it 

is invertible (this is a Lie algebra version of the inverse function theorem, with ^ playing 
the role of the maximal ideal in the ring of commutative formal power series and d] 
playing the role of m/m^ = cotangent space). □ 

Continuing with the proof of Proposition 5.11, note that we have CH = a o h hj 
construction, so in view of Lemma 5.12, it suffices to prove that there are isomorphisms 
h*{plM ®pIN) = plM<gp*N, bifunctorial with respect to M, G ^g(s)- We will show 
that, in fact, there are functorial isomorphisms h*p\M = p\M and h*p2N = p^N. 
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Observe that there is a commutative diagram 

/ 

Q X g X Q 

7 



where / is given by 

f{x,y) = {x,(f){x,y)), 
and where 7 is the conjugation action map^^, given by 

Note also that Pi o f = Pi- Now, by the definition of equivariance, we have functorial 
isomorphisms 7*M = plM for all M G ^g{q)- Thus we obtain a sequence of functorial 
isomorphisms: 

h*p*M ^ (pi o hYM =(70 /)*M = /*7*M = f*plM = {pi o /)*M = plM 

for every M e ^^(g). An analogous construction yields functorial isomorphisms h*P2N = 
^2^^ for all N e ^g(0)- This proves the proposition. □ 

We warn the reader that the result we have proved does not imply that ^g{G) and 
^0(0) are equivalent as monoidal categories. In fact, in general there does not exist a way 
of choosing the isomorphisms (5.1) so that they would be compatible with the natural 
associativity constraints on ^g{G) and ^0(0)- 

Proof of Theorem 5.10. A detailed proof will appear in the final version of the paper. Let 
us indicate the main ideas, from which the full argument can be easily recovered. 

In view of Proposition 5.11 and the remarks in §5.2, the functor exp^ : ^0(0) — ^g{G) 
induces a bijection between the set of (isomorphism classes of) minimal idempotents in 
&g{q) a-iid that in &g{G). On the other hand, by Proposition G.ll, the Fourier-Deligne 
transform induces an equivalence of monoidal categories T : ^g{q) — ^ ^g{q*), where 
^g(0*) is equipped with the monoidal structure M Q N — (M (8) A^)[— dimG]. Hence 
minimal idempotents in ^g{G) correspond to minimal idempotents in ^g(0*) with respect 
to 0. Let : Vl ^ Q* he the inclusion of a G-orbit, let (Q^)^ denote the constant 
sheaf on Vt with stalk Q^, and let (Q^)g* denote the constant sheaf on g* with stalk 
Q^. Put d = dimG. Then (Q^)g*['^] ^ ^^it object in ^g(0*) with respect to 0. Let 
en = {in)*{Qe)n[d]- By adjunction, we have a natural morphism (Q£)g*['^] ~^ which is 
clearly an idempotent arrow. The Hecke subcategory of ^g(0*) defined by en identifies 
with ^g(^)- Moreover, it is easy to check that cq is a minimal idempotent of ^g{q*), and 
every minimal idempotent of ^g{q*) has this form. The rest is rather computational. □ 




Note that it is the second copy of g that acts on the first one, and not the other way around. 
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6. UNIPOTENT GROUPS ARISING FROM ASSOCIATIVE ALGEBRAS 

In this section we introduce a large collection of examples that are quite different from 
the ones we have considered so far, in the sense that the groups we will discuss may have 
"large" nilpotence class (relative to the characteristic of the ground field) , and therefore 
the orbit method cannot be used to study their representations. 

6.1. Unipotent lineEir groups. Let n G N. Wc define a group scheme ULn over SpecZ 
as follows. For every commutative ring R, we let ULn{R) be the group of unipotent 
upper-triangular matrices over R of size n. It is clear that the functor Spec R \ — > U Ln{R) 
is representable by an affinc group scheme whose underlying scheme is the affine space 
^n(n-i)/2 dimension n(n — l)/2 over SpecZ. Following A. A. Kirillov, we call C/L„ the 
unipotent linear group (of size n). Note that the nilpotence class of C/L„ is equal to n — 1. 

In particular, if g is a power of a prime p, we have the finite group UL{n,q) := U Ln{¥q) 
of order Complex irreducible representations of UL{n,q) have been studied by 

several authors: see, for example, [Ka77, Ki95, And95, YanOl, And02]. There are some 
interesting results in this theory, but also many unanswered questions. The main difficulty 
lies in the cases where n is large compared to p; for example, if n > p, then the orbit 
method explained in Section 2 cannot be applied to the group UL(n, q). One of the first 
nontrivial facts about representations of UL{n, q) is the following 

Theorem 6.1 (Isaacs). The dimension of every complex irreducible representation of 
U L{n, q) is a power of q. 

This result was conjectured by J. Thompson and proved by I.M. Isaacs in [Isa95]^^ (for 
n < p, it was proved in [Ka77]). E. Gutkin claimed to have proved this fact in [Gu73]; in 
fact, he stated a much stronger result (see Theorem 6.6 below). However, his proof has a 
gap, and to the best of our knowledge Isaacs' proof is the first correct one. 

6.2. Unipotent algebra groups: chciracter theory. We now present a wide general- 
ization of the unipotent linear groups. 

Definition 6.2. Let k he a commutative ring, and let A be an associative A;-algebra in 
which every element is nilpotent (in particular, A is then non-unital). We define A^ to be 
the group that has A as the underlying set and xoy = x + y + xysiS the group operation. 
(Informally speaking, A^ — 1 + A.) Note that the assumption that every element of A is 
nilpotent is used to ensure that elements oi A^ have inverses. A group of the form A^ is 
called an algebra group over k. 

Definition 6.3. In the situation of Definition 6.2, assume that A is free of finite rank as 
a /c-module. For every commutative unital /c-algebra R, wc have the group {A ®fc R)^ . 
It is clear that the functor Spec R \ — > {A (g)^ R) ^ is representable by a unipotent group 
scheme over k. By abuse of notation, we denote it by A^ , and call it the unipotent algebra 
group defined by A. 

^^We thank Jon Alperin and George Glauberman for providing us with this reference. 
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Example 6.4. Let A be the algebra ofnxn strictly upper triangular matrices over Z (with 
respect to matrix multiplication). Then ^4^ = C/L„ as group schemes over Z. 

Remark 6.5. Note that with the standard definition of an algebra group [lsa95, Ha04] one 
starts with a finite dimensional associative unital algebra A over a field k, and forms the 
group 1 + J, which is a subgroup of the group of units of A, where J is the Jacobson 
radical of A. However, this is a special case of Definition 6.2, because J is an associative 
algebra over k in its own right, and every element of J is nilpotent. Conversely, if A is as 
in Definition 6.2, then we can form an algebra A = k ■ 1(B A over k by formally adjoining 
1 to A, and it is clear that A is then the Jacobson radical of A. 

Theorem 6.6 (Gutkin-Halasi). Let A be a finite dim,ensional associative nilpotent al- 
gebra over Fg. Then every complex irreducible representation of A^ is induced from a 
1-dimensional representation of a subgroup of the form , where B C. A is an associa- 
tive subalgebra. 

Remarks 6.7. (1) In the situation of Theorem 6.6, Isaacs proved ([Isa95], Theorem A) 

that the dimension of every irreducible representation of A^ is a power of q. In view 
of Example 6.4, Thompson's conjecture (Theorem 6.1) is a special case of his result. 

(2) In turn, it is clear that Isaacs' result would follow immediately from Corollary 5.9 
(which depends on Conjectures 4, 5 and 6 in §5.7) applied to the group G — A^ (8)iFgF. 

(3) On the other hand, it is also clear that Theorem 6.6 is substantially stronger than 
Isaacs' result. The theorem was stated by Gutkin in [Gu73] and proved by Halasi 
in [Ha04]. However, Halasi's proof itself relies on Isaacs' result; in other words, one 
cannot use [Ha04] to reprove Theorem A of [Isa95] . 

(4) The situation was somewhat improved in [Bo06a] where a direct proof of Theorem 
6.6 which is based on Halasi's methods but avoids using [Isa95] was given. 

(5) In the special case where A^ = (0), Theorem 6.6 was proved by C.A.M. Andre [And98]. 
In fact, Andre pointed out that for every functional f E A* = B.omf^{A,¥q), there 
exists a polarization of ^4 at / which is multiplicatively closed. Here we consider 
A as a Lie algebra in the usual way: [a, b] = ab — ba. (The proof of this claim is 
given in Theorem D.9.) In the case where = (0), the group A^ is of exponential 
type, namely, the exponential map exp : A ^ A^ can be defined by the usual series, 
exp(a;) = x -\- x'^/2 + x^/6 + • • • . If S C A is a multiplicatively closed polarization 
at /, it follows that — ex'p(B), which together with the usual orbit method 
(cf. [Ki62, BSx]) implies Theorem 6.6. However, when A^ ^ (0), the proof of Gutkin's 
claim is substantially more difficult. 

To end this discussion, we would like to mention that many interesting results about 
characters of the unipotcnt linear groups obtained in [YanOl] and [And95, And02] have 
recently been generalized to algebra groups over finite fields in [DI05]. Unfortunately, this 
theory hes beyond the scope of our article. 
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6.3. Unipotent algebra groups: geometric aspects. We briefly consider unipotcnt 
algebra groups from the point of view of the questions posed in Section 1. Let A be a finite 
dimensional associative nilpotent algebra over F^, and the corresponding unipotent 
group over F^. 

Theorem 6.8 (see [Bo06a]). There exist injective FiCq-equivariant maps 

: A^r.) {A^.)f^ 

for all pairs of positive integers m\n, which satisfy = o whenever m\n\k and 
commute with all automorphisms induced by algebra automorphisms of A overWg. 

Thus the answer to question (1) is positive. One can also prove [Bo06a] that the base 
change maps arc surjcctive in some special cases, but in general question (2) remains 
open, as do questions (3) and (4). (However, if Conjectures 4, 5 and 6 in §5.7 hold, then 
the answer to question (4) is positive for unipotent algebra groups.) 

6.4. Other examples. We have seen one way of generalizing the unipotent linear groups 
to produce interesting examples of unipotent algebraic groups. Another way of producing 
infinite families of examples is to replace the groups ULn with maximal unipotent sub- 
groups of classical simple groups other than SLn. It was already observed in [Isa95] (see 
also [Pre95]) that these groups exhibit behavior different from that of the algebra groups. 
Lusztig pointed out [Lu03] that these groups also illustrate some nontrivial aspects of 
the theory of character sheaves for unipotent groups. In the remainder of this section we 
will concentrate on maximal unipotent subgroups of the symplectic groups Sp2n{k) (i-e., 
simple groups of type C) and their generalizations, and in the next section we will present 
Lusztig's example, which is the case n — 2 and k — F20 . 

6.5. Unipotent symplectic groups. These groups are defined as maximal unipotent 
subgroups USp{2n,q) = USp2n(^q) of the symplectic groups Sp{2n,q) — Sp2n{^q)- This 
is a special case of the following 

Definition 6.9. Let A be an associative algebra over a commutative ring k in which every 
element is nilpotent, and let a : A — > A be an anti-involution, i.e., a is /c-linear and 
satisfies a{xy) — a{y)a{x) for all x,y & A, and — 1. It is clear that a induces an anti- 
automorphism of the group A^. The generalized unipotent symplectic group associated to 
this data is the subgroup 

Sp{A, a) ^ {x e A"" \ x + a{x) + xa{x) = O}. 

In other words, since we (formally) have 1 + x o y = 1 -\- x + y + xy = {1 -\- x){l + y), so 
that A^ should be thought of as the group 1 + A, we should likewise think of Sp{A, a) as 
the group of elements g & 1 + A such that (7{g) = g^^. 

Remark 6.10. Let V be a finite dimensional vector space over a field k, equipped with 
a symplectic form cu, and construct a complete flag = Vq C Vi C ■ • ■ C V2n = V oi 
subspaces of V in the following way. Pick a Lagrangian subspace L <Z V with respect 
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to cu, let = Vo C Vi C ■ ■ • C V„ = L be an arbitrary complete flag of subspaces of 
L, and define Vj to be the orthogonal complement of V2„_j in V with respect to cu for 
all n < j < 2n. If A is the algebra of cndomorphisms (I) of V satisfying 0(Vi) C Vi_i 
for 1 < i < 2n, then the equation uj{a{(f)){x),y) = uj{x,(f){y)) defines an involution a of 
A, and it is easy to check that Sp{A,a) is a maximal unipotent subgroup of Sp{V). In 
particular, U Sp{2n, q) is indeed a special case of Definition 6.9. 

When p = char(Fg) = 2, the groups USp{2n,q) behave differently from UL{2n,q); 
in particular, in Section 7 we explain, following [Lu03], the classification of irreducible 
representations of the group USp{A,2^) (s e N), and show that it has irreducible rep- 
resentations of dimension 2^~^ if s > 2. However, when p > 2, this phenomenon does 
not occur. Andrea Prcvitali proved in [Pre95] that if p > 2, then the dimension of every 
complex irreducible representation of USp{2n, q) is a power of q. The proof of the next 
proposition is very similar to Previtali's proof, and is only included here for the sake of 
completeness. Before giving it, we should point out that the key step in the proof (apart 
from using Isaacs' results) is the fact that the coefficients of the power series expansion 
for the function (1 + 1)^/^ only have powers of 2 in the denominators. 

Proposition 6.11. Let P = Sp{A,a) be a generalized unipotent symplectic group, as in 
Definition 6.9, where k = ¥q and A is a finite dimensional associative nilpotent algebra 
overFq. Ifp = char(Fq) > 2, then the dimension of every complex irreducible representa- 
tion o/P is a power of q. 

Proof. We use Theorem D of [Isa95]. Following loc. cit., we say that a subgroup H C A^ 
is strong if for every Fg-subalgebra B C A, the order of the intersection HflB^ is a power 
of q (in particular, \H\ itself must be a power of q). By Isaacs' Theorem D, if if C A^ is 
a strong subgroup, then the dimension of every p e if is a power of q. Thus it suffices to 
prove that P is a strong subgroup of A^. 

To avoid confusion, we will think of ^4^ as the group of elements of the form g — 1 + x 
in what follows. Let B ^ A he any Fg-subalgebra, and let C = B f] cr(i?); this is a 
cr-stable Fg-subalgebra of A, and hence a restricts to an anti-involution of C. Now if 
g = 1 + X & TnB^ , then x E B, and since 1 + a{x) = a{g) = g^^ must also lie in TnB^ , 
we see that x e C. It follows that 

rnB- = {geC'<\g-' = a{g)}, 

and hence, replacing A with C, we are reduced to the following 

Lemma 6.12. With the assumptions of Proposition 6.11, the order of V is a power of q. 

Proof. Since p > 2, we can write A = A^ © A_ (direct sum of F^-subspaces) , where 
A± — Ker(cr=Fid : A —>■ A). We will define an explicit bijection between P and A_, which 
will prove the lemma. 
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Pick X G A and write x = a;+ + with x± G A±. If 1 + x G F, then in particular 
1 + a{x) must commute with 1 + x, whence [ 1 = 0. Thus 

— X + a{x) + xa{x) — 2x+ + — a;^, 

which we rewrite as 

{1 + x+f ^l + x^L. 

We now show that, given x_ G A_, there exists a unique x+ G A^ satisfying this equation, 
and, moreover, this x+ commutes with This will imply that the map 

r — > A^, l + x\ — > X- 

is a bijection, and will complete the proof. Given a;_ G A_, let us define x'^ & A using 
Newton's binomial formula: 

< = -i + (i + -^-)"^ = -i + E('f)-^^ = Y-T + --' 

there is no question of convergence because A is nilpotent. All coefficients have the form 
where A; G Z and m G N, whence the expression above is well defined. 

By construction, x°^_ G (l + x'^Y — l + and x° commutes with every element of 
A that commutes with x"^. Now if x+ G A+ satisfies = 1+x'^, then x+ commutes 

with x"^ and therefore with x"^. Since = {l+x°^y, and since the order of A^ is 

odd, it is immediate that a;+ = x^, which completes the proof of the lemma, and hence 
of the proposition. □ 

7. Maximal unipotent subgroup of Sp^ (after G. Lusztig) 

G. Lusztig [Lu03] classified the irreducible representations of a maximal unipotent sub- 
group of Sp4{k), where k is a finite field. He observed that if k has characteristic 2 and 
order greater than 2, then the dimensions of some of these representations are not powers 
of q. The significance of this observation is explained in §7.9. 

We reproduce Lusztig's classification in §7.8. We describe two slightly different ways to 
derive it (see §7.4 and §§7.5-7.7). Both methods rely on standard material from §§7.1-7.3. 
In these subsections the ground field k can be arbitrary. 

7.1. The Siegel peirabolic. Let {V,uj) be a finite dimensional symplectic vector space 
over k (later we will assume that dimF = 4, but for now V is arbitrary). Let Sp{V) 
denote the group of all linear automorphisms of V that preserve uj. Fix a Lagrangian 
subspace L G V and a complementary Lagrangian L* C V, i.e., V = L (B L*. This 
notation is justified by the fact that uj induces a perfect pairing L x L* ^ k, and hence 
identifies L* canonically with the dual space of L. 

^^In fact, a more general statement holds. If p is a prime, a € Zp, and j & 1', j > 0, then the binomial 
coefficient (") lies in Zp. This is well known for a e Z, and follows for all a e Zp by continuity. 
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Define 

P^{geSp{y)\g{L*)<ZL*], 
a parabolic subgroup of SpiV). Then 

Lp = {ge SpiV) I g{L*) C L\ g{L) C L} 
is a Levi subgroup of P, and 

Up^ {g e Sp{V) I g\L* = idL*} 

is the unipotent radical of P. It is possible to describe Up more explicitly. Namely, if 
g E Up, write g = 1 + C for some C G End(K). Then C{L*) = 0, and it is easy to check 
that the condition that g preserves u is equivalent to the condition that C(L) C L* and 
that the bilinear form B{u, w) = lj{Cu, w) on L is symmetric. This gives the identification 

Up = {Sym'LY; 

more precisely, Up is the underlying additive group of the vector space {Syw?L)*. Since 
Lp = Aut(L), we obtain 

P ^ Aut(L) K {Sym^iy 
(with {Syrn?L)* being the normal subgroup). 

7.2. The maximal unipotent subgroup. If we choose a maximal unipotent subgroup 
H C Aut(L), then U = H t< {Syrn?L)* is a maximal unipotent subgroup of P, and hence 
of Sp{V). Note also that the dual unipotent group Up can obviously be identified with 
the underlying additive group of Sym^L. The latter can be naturally viewed as the space 
of homogeneous quadratic polynomials on L*, and the action of U (and of P) on Syw?L 
is induced by its natural action on L* . 

Since Up is abelian, the action of f/ on f/p by conjugation factors through the action 
of H, which will be denoted hy B ^ (for B e Up,h e H). Explicitly, ii B e Up is 
thought of as a symmetric bihnear form on L, and h E H C Aut(L), then B^{u,w) — 
B{h-\h-^w). 

7.3. Matrix realization. Let us recall from §6.1 that U Ln{k) denotes the group of unipo- 
tent upper-triangular matrices of size n over k. In order to relate the construction of the 
maximal unipotent subgroup U C SpiV) given above to the description of USpi{k) used 
in [Lu03], we recall one of the standard realizations of the group Sp2n{k). If M is a square 
matrix, we will denote by M'^ the matrix obtained by reflecting M with respect to its 
antidiagonal (i.e., the diagonal going from the lower left corner to the upper right corner). 
This is not to be confused with the usual transpose of M, which is denoted by M*. Now let 
S e GL2n{k) be the diagonal matrix with diagonal entries (1, —1, 1, —1, . . . , 1, —1). Then 
Sp2n{k) can be deflned as the subgroup of GL2n{k) consisting of matrices M satisfying 

= SM'^S~^. With this realization, the intersection USp2n{k) := Sp2n{k) n UL2n{k) 
is a maximal unipotent subgroup of Sp2n{k). 
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Further, let J denote the 2n x 2n antidiagonal matrix with all antidiagonal entries 
equal to 1. It is then easy to check that = JM*J~^, which implies that the condition 
= SM^S-'^ is equivalent to M\JS)M = JS. Thus Sp2n{k) can alternatively be 
described as the group of linear automorphisms of A;^" which preserve the symplectic 
form uo given by the matrix JS. This matrix is also antidiagonal, with antidiagonal 
entries — 1,1,— 1,1,...,— 1,1 (from the top right corner to the bottom left corner). As a 
Lagrangian subspace L C A;^" we choose the span of the first n standard basis vectors, 
and as a maximal unipotent subgroup of Aut(L) = GLn{k) we choose H = ULn{k). We 
now see that the subgroup U = H K {Syw?L)* coincides with USp2n{k). 

7.4. Little groups method. Observe now that if n = 2, then if = Ga is abclian. Hence, 
if k is finite, it is easy to classify all irreducible representations of USpi{k) and find their 
dimensions using the decomposition USp4{k) = H t< {Syw?L)* and the "little groups 
method" of Wigner and Mackey. We leave it as an exercise^^; having done it, the reader 
will see that if is a power of 2, then some irreducible representations have dimension q/2 
(which is not a power of q unless q = 2). The particular case of the little groups method 
that suffices to do the exercise can be summarized as follows. 

Proposition 7.1. Let H , A he finite ahelian groups, let H act on A by group automor- 
phisms, and form the semidirect product G = H t< A. Let A* denote the Pontryagin dual 
of A and consider the induced action of H on A*. There is a natural bijection 

G \^pairs (f),'^)}, 

where Q G A* is an H -orbit and ip is a 1-dimensional character of the stabilizer C H 
for some x G ^2. {Note that does not depend on the choice of x ^ ^ because H is 
ahelian.) Given a pair (^2,^) of this form, the corresponding irreducible representation of 
G is constructed as 

p(Q, ijj) = IndgxKA(V' ® X), 

where ijj and x are the natural extensions ofip and x to K A, defined by ip{ha) — ip{h) 
and x(/ia) = x(a) for h e and a & A, respectively. 

Remark 7.2. The little groups method can be formulated in much greater generality; for 

instance, it can be used to classify the irreducible representations of a finite group G 
with a nontrivial normal subgroup N in terms of irreducible representations p of N and 
irreducible representations of the corresponding "little groups" (the little group G^ G G 
is the stabilizer of the isomorphism class of p). In this context the method is usually 
known under the name "Clifford theory". We refer the reader to [NT89], §3.3 for a nice 
exposition of this topic. 

■"^^Hint: if charfc = 2 the i?-stabilizers of some elements of [Syrn^L) \ {0} have order 2, while if 

charfc 7^ 2 all the stabilizers arc trivial. To see this, identify Sym^L with the space of polynomials 
f € k[x\ of degree not greater than 2 and H with the group of translations x ^ x + a, a & k. If char k = 2 
and / has two distinct roots in k, then the group of translations x ^ x -\- a preserving / has order 2. 
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Remark 7.3. The method described in this subsection has the foUowing drawback. In 
characteristic 2 there exists a purely inseparable isogeny ^ : Sp^ Sp^ such that the 
parabolic ^(-P) is not conjugate to P (i.e., ^(-P) is the stabihzcr of a line). We can choose 
^ so that USpi is stable under ^. Then ^ : USp^ USp4 induces an automorphism of 
USp4{¥2k). Unfortunately, the approach to the classification of the irreducible represen- 
tations of USp4{¥2k) presented above breaks the ^-symmetry. However, this symmetry is 
preserved by the approach explained below. 

7.5. Second approach. We now explain a different approach to the classification of 
irreducible representations of USp4{¥q), which yields an answer that is closer in spirit to 
the one described in §7 of [Lu03]. Consider first U = USp^ as an algebraic group over 
an arbitrary field k. The quotient U /[U,U] is isomorphic to a direct sum of two copies of 
Ga (more precisely, these two copies correspond to the two simple roots for Sp4{k)). It is 
easy to see that [U, U] is also isomorphic to a direct sum of two copies of G^; in particular 
[U, U] is commutative. 

Lemma 7.4. If char k — 2, then the center Z of U coincides with [U,U]. Otherwise, 
it is a subgroup of [U, U] isomorphic to Ga {more precisely, it is the subgroup of [U, U] 
corresponding to the maximal root of Sp4{k)). 

The proof is given in §7.6. 

Now suppose that A: = is a finite field of characteristic 2. Fix a character x '■ Z{k) 
{±1}, and let us classify the irreducible representations of U{k) on which Z{k) acts via 
X- This is the same as classifying the irreducible representations of the amalgamated 
sum (=coproduct) of U{k) and {±1} over Z{k) on which the element —1 e {±1} acts as 
multiphcation by —1. Let us denote this amalgamated sum by H{x)- By Proposition B.4, 
such representations correspond bijectivcly to the 1-dimcnsional characters of the center 
of H{x) which take value —1 on the element —1 e {=tl}- It therefore remains to describe 
the center of H{x)- 

Lemma 7.5. (i) If x is trivial, then II{x) is commutative, 
(a) There are 2{q — 1) characters x for which the center of II{x) equals {±1}. 
(Hi) For all other characters x, the center of H{x) is a direct sum o/{±l} and two other 
subgroups of order 2. 

The proof is given in §7.7. At the end of the section we present Lusztig's formulas for 
the irreducible characters of USp4{¥q), where q is a, power of 2. They can be obtained 
using the approach we have just outlined. 

7.6. Proof of Lemma 7.4. We return to the coordinate-free framework described in 
§7.1 and §7.2. We assume that dimV = 4, so that dimL = 2. We fix a line £ G L such 
that H consists of all automorphisms h of L that act trivially on i and on the quotient 
line L/i. As remarked before, H = Ga, and in particular is abelian. Moreover, C/p = 

in this case. 
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Let us describe the center of U. We will write the elements of U as pairs {h, B), where 
h & H and S is a symmetric bilinear form on L. In this notation, the multiplication on 
U looks like 

ih,B) ■ {h',B') = {hh',B^'''^'" + B'). 
Since H is commutative, the condition that {h, B) commutes with all of U breaks up into 
two conditions: (/i,0) must commute with for every B', and must commute 

with {h', 0) for every h'. In other words, it is equivalent to the following two conditions: 

(a) EC*')"' = B for all h' e H, and 

(b) {B')'^ — B' for every symmetric bilinear form B' on L. 

Since H obviously acts faithfully on {Syrri^L)*, the second condition is equivalent to 
h ~ 1. The first condition is equivalent to 

B{h'u, h'w) = B{u, w) for all h' & H and all u,w e L. (7.1) 

Fix f G f 7^ 0. Taking w = v in the equation above and letting h' be arbitrary shows 
that B{v,v) = 0. In characteristic 2 this condition is also sufficient for (7.1) to hold, since 
for any u E L we have h'u = u + av for some a E k, whence 

B{h'u, h'u) = B{u, u) + a^B{v, v). 

However, in characteristic different from 2, we have 

B{h'u,h'u) = B{u,u) + a^B{v,v) + 2aB{u,v), 

so the condition (7.1) is equivalent to B{u,v) = for all u E L. We conclude that the 
center of U consists of all (0,5) such that B{i,i) = (resp., B{L,i) = 0) if char/c = 2 
(resp., char A; 7^ 2). Thus the center is isomorphic to in characteristic 2 and to Ga in 
characteristic different from 2. 

In any characteristic the commutant of U equals the set of pairs (0, B) such that 
B{i,i) = (this group is isomorphic to G^). So we see that the center of U is contained 
in [U,U], and it equals [U, U] if and only if the characteristic of k equals 2. This proves 
Lemma 7.4. 

7.7. Proof of Lemma 7.5. We now consider the case where k = ¥g, with q a power of 
2. Note that specifying a character % : Z{k) —>■ {±1} is the same as specifying a linear 
map / : Z{k) — > k. Namely, given such an /, we obtain a character x defined by 

x{B)=MfiB)), BeZ{k), 

where ipo '■ k ^ is a fixed nontrivial additive character. As explained above, Z{k) is 
identified with the space of hnear functionals B : Sym^L — > k which vanish on Sym^i C 
Sym'^L. Hence the dual space Z{k)* = Hom(Z(/c), /c) is naturally identified with the 
quotient of Syrn^L by the line Syrn^l. Now modulo this line, every element of Sym^L 
is easily seen to be decomposable, and in fact, we have 4 essentially different possibilities 
for an element of {Syrn?L) /{Sym?t): 

(1) 0; 
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(2) w where v E i and w E L\i; 

(3) w <S)W, where w & L\£; 

(4) {w + v) w, where v E I and w E L\£. 

It is a trivial exercise to show that these in fact exhaust all the possibilities. Moreover, 
since in the cases (2) and (3) w is only determined up to adding an element of £, it is easy 
to see that there are {q — 1) different elements of {Syrn?L) / {Syrn?(!^) of the form (2) and 
(g — 1) different elements of the form (3). 

On the other hand, the same argument that was used to find the center of U {k) also 
shows that an element {h, B) e U{k) maps to a central element of H{x) if ^-^d only if the 
following two conditions hold: 

(a') -B) = l for all h' e H, and 

(b') xiiB'r -B') = 1 for every symmetric bilinear form B' on L. 

Let / G Z{k)* be a linear functional represented by an element of one of the types (1)- 
(4) above, and let x '■ — {±1} denote the corresponding character. Let us describe 
the center of H{x)- If / is of type (1), then H{x) is obviously abehan. In all other cases 
the natural projection U{k) — > H{x) is surjective, so it suffices to describe the set of all 
elements {h,B) e U{k) satisfying conditions (a') and (b') above. 

Assume that / is of type (2), so that f{B) = B{w,v) for every B E Z{k). Then 
condition (a') is equivalent to iIjo{B{w,v)) = ilJo{B{h'w,v)) for every h' E H. But 
since w ^ £, this obviously forces B{v,v) = 0. Similarly, condition (b') is equivalent 
to i/jo{B' {hw , v)) = ipo{B'{w,v)) for every B' , which obviously forces h — 1. Thus, in 
this case, the center of H{x) is the image of the center of U{k), and hence coincides with 
{±1}. 

Assume next that / is of type (3). Then condition (a') is equivalent to i/jq{B{w,w)) = 
ipolB^h'w. h'w)) for every h' E H . Writing h'w = w+av^ the condition becomes equivalent 
to tljQ{a^B{v/u)) = 1, which again forces B{v,v) = since the map k ^ k, a ^ o? ^ is 
bijective. Condition (b') is equivalent to ipo{B'{hw,hw)) = '0o(-S'(w, w)) for every B', 
which similarly forces h — 1. Thus the center of H{x) is again {±1} in this case. 

Finally, let / be of type (4). Then condition (a') is equivalent to '4>q{B{w + v,w)) — 
■iI)q{B{w + av + v ,w + av)) ioi a\\ a E fc, which reduces to ■?/'o((ct^ + Ck)-B(t', ?;)) = 1. This no 
longer forces B{v, v) = 0. Indeed, the image of the map k A;, a i-^ + «, is an additive 
subgroup of k of index 2, so there are two possibilities for B{v,v). Moreover, condition 
(b') is equivalent to '^q{B' [hw -\- v , hw)) — '^q{B'{w-\-v, w)) for all B' . Write hw — w + Pv 
for some P E k; then the condition becomes B'{w + (3v + v,w + (5v) = B'{w + v, w) (since 
B' is arbitrary, we can ignore It is clear that again we have two choices: (5 — and 
P = l. 

Combining these results, we see that when / is of type (4), the center of H{x) has 
order 8, and is the homomorphic image of the set of pairs {h,B) E U{k) satisfying the 
conditions in the previous paragraph. This completes the proof of Lemma 7.5. 
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To summarize, wc have exphcitly described the center of H{x) iii each of the cases 
(l)-(4) hsted above, and this yields a classification of the irreducible representations of 
U{k) that act as x Z{k). In particular, one obtains their characters. 

7.8. Irreducible chciracters. As in §7.3, we identify USp4{k) with U{k), and it is easy 
to see that U (k) can in turn be identified with the group consisting of all matrices of the 
form 

/lab c \ 
1 d b + ad 

1 a 

\o 1 y 

where a, b,c,d E k. We will denote this matrix by [a, b, c, d]. Lusztig's description ([Lu03], 
§7) of the irreducible characters of U {k) is as follows. 

(i) There are one dimensional characters U{k) — > of the form 

[a, b, c, d] I — ^ tpQ^xa + yd) 

(one for each pair x,y & ¥g), where -00 ^ F^ ^ is a fixed nontrivial additive 

character. 

(ii) There are q — I irreducible characters of degree q of the form [0, 6, c, 0] ^ q ■ il'o{xb) 
(all other elements are mapped to 0), one for each x e F^. 

(iii) There are q — 1 irreducible characters of degree q of the form [0, b,c,0] i— > g ■ 4'o{xc) 
(all other elements are mapped to 0), one for each x e F^. 

(iv) There arc 4(g — 1)^ irreducible characters of degree q/2, one for each quadruple 
{ao, do, 61,62) where ao G ¥g,do G F^ and ei : {0,ao} — > {±1}, ^2 : {0,do} — > 
{±1} arc group homomorphism. Namely, the character corresponding to such a 
quadruple is given by [a, b, c, 0?] 1— >• (g/2) • ei(a) • €2{d) ■ '?/^o(oo ^ ' do^ ' {ba + bao + c)) 
if a e {0, ao} and d E {0, do}; all other elements are sent to 0. 

7.9. Dimensions of representations. Let us fix g = 2'', s > 2. We use Lusztig's 
computation presented above to show that question (4) in §1.4 has a negative answer for 
the group USp4 over the finite field Fg. 

Lemma 7.6. Suppose that question {4) has a positive answer for a given algebraic group 
G over F^, and let x be an irreducible character of G{¥q) over Q^. Then there exist a 
complex T G D\{G®^¥, Q^) and an isomorphism ip : Pr* satisfying the following 

property. For each n eN, let tpn '■ (Pr")*^ denote the isomorphism given by 

and let tn G{¥gn) — > denote the corresponding trace function, as in ^1.4- Then 
ti — X, and for each n G N, i„ is an irreducible character ofG{¥qn). 

This statement is obviously a special case of the property (4-iii) in §1.4. We also have 
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Proposition 7.7. Suppose A C is a finite nonempty subset, suppose we are given a 
function A — > Z \ {0} denoted kx, and form 



F(n)=5^M" for n= 1,2,3,... (7.2) 



AeA 



Then the formula 



cannot hold. 



nn) = if , f " = J' (7.3) 

g", or 1 for n>2 



The proof is given in §7.10. Now it is easy to see that Lusztig's computation, together 
with the lemma and the proposition above, imply that question (4) in §1.4 has a negative 
answer for G = USp4^ over F^. Indeed, if the answer is positive, let x be an irreducible 
character of G{¥q) with x(l) = q/2, and let JF, ip be as in Lemma 7.6. Put F{n) = tn(l). 

Then (7.3) holds by Lusztig's computation. On the other hand, let A C be the set 
of nonzero eigenvalues of t/j acting on the stalks W{T)i of the cohomology sheaves of 
at 1 G G{¥g), and let k\ be their multiplicities taken with the sign (—1)*. Then (7.2) is 
satisfied by construction, and we have a contradiction. 

7.10. Proof of Proposition 7.7. This subsection is completely independent from the 
rest of the paper. The statement of the proposition we need to prove is purely algebraic, 
and hence we can replace with C. This will allow us to use analytic arguments below. 

For each A e C^, consider the character fx : Z —>■ given by f\{n) = A". Let us 
recall that a subset 5" C N is said to have density 5 if 

N-^oo N 

Lemma 7.8. Given a subset S QN of density 1 and a function f : S ^ C, define 

nGSn[l,N] 

provided that this limit exists. If X E , \X\ < 1, then Is{f\) exists and is given by 

ifX = l, 



Hfx) - 



^/A7^1. 



Proof. Since |A| < 1, we have \fx{n)\ < 1 for all n e N. As 5" has density 1, this implies 
that 



N-^oo N 

ne{n\s)r\[i,N] 

Thus Isifx) exists if and only if /n(/a) exists, and if they do exist, they are equal. The 
case 5" = N of the lemma is completely straightforward. □ 
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Remark 7.9. It is clear that the operation / i— >• /§(/) is a "partially defined linear func- 
tional" on the space of functions / : 5" — > C. Namely, if /, gi : 5" — > C are such that Is{f) 
and Is{g) exist, then for any a, 6 e C, Is{(if + hg) also exists an equals als{f) + hls{g)- 

Corollciry 7.10. If S C N is any subset of density 1, then the restrictions of the functions 
{/aIagCx S are linearly independent. 

Proof. Otherwise there exists a finite nonempty subset A C and a function A — > C^, 
A I— ca, such that ^^eA '^'a/a(^) = for all n G S*. Let G A be an element of 
the maximal absolute value. From the previous remark and the lemma, it follows that 
Is (Eaga^a/m-ia) = 7^ 0. On the other hand, EagaCa/m-iaH = yW"" Eaga ^a/aH = 
for all n G 5", which is a contradiction. □ 

Proof of Proposition 7.7 with replaced by C. Assume that (7.3) holds. We will derive 
a sequence of statements that will eventually lead to a contradiction. Let R = maxAgA |A|. 
By Corollary 7.10, one of the values or q"'/2 must be achieved infinitely many times in 
(7.3) (indeed, this must be so on a subset of N whose complement does not have density 
1). This immediately implies that R > q. Now let // G A be an element with = R. 
Then on the one hand, /^(/^-i • F) — k^, a nonzero integer. On the other hand, (7.3) 
implies that for every A?" G N, we have 

JV N N 

n=l n=l n=l 

note that the RHS is always < 1, and — > as A?" — > oo if > gf. This means that R — q, 
and, in addition (since \k^\ > 1), the set of values n G N for which F{n) = has density 
1. But then F{n) = q^ for all n G N by Corollary 7.10, which contradicts (7.3). □ 

Appendix A. Characters of finite groups 

A.l. Classical theory. The main goal of this section is the study of irreducible charac- 
ters of a finite group H that are invariant under a given automorphism of IT; this study 
is motivated by its application to the theory of character sheaves in the setting of the 
orbit method (see Section 4). On the other hand, the proofs of the facts that we need 
are natural extensions of the proofs of the classical results about irreducible characters of 
finite groups (which is the case when = idn). Therefore we begin by reviewing a bit of 
the classical theory, and then bring the automorphism into the picture. 

We take C as our field of coefficients to avoid introducing more notation, even though 
all of what follows is equally valid over an arbitrary algebraically closed field of char- 
acteristic zero. Let us fix a finite group H and consider two nonisomorphic irreducible 
representations, V and W, of H over C. Recall that CLE denotes the group algebra of H. 

Lemma A.l. Let m : U — > C be a matrix element ofV. Then the element 

7en 



44 



M. BOYARCHENKO AND V. DRINFELD 



acts by on W. (This lemma is in fact valid for representation over any field.) 

Proof. Recall that to say that m is a matrix element of V means that 777.(7) = foili^o) 
for some vq e V and /o G V*. Now fix wq e W. The map v 1-^ fo{v)wo is a linear map 
V — )• W. Hence the map 

is a H-equivariant linear map V — ^ W, and is therefore by (the weak form of) Schur's 
lemma. But this map takes vq to • wq, whence am ■ wq — 0. Since wq &W is arbitrary, 
the proof is complete. □ 

Corollciry A. 2. In the same situation, define 

card(n) ^ 
Then ey acte by the identity on V and by onW. 

Proof. It is easy to see that ev{W) = 0. Indeed, let (vi) be a basis of V, let (/j) be the 
dual basis of V*, and let 7771(7) — fiil'^i) be the corresponding matrix elements of V . 
Then 

dim V sr^ 

card(n) 

whence the lemma applies. 

Moreover, it is clear that ey is a central element of CII, so by (the strong form of) 
Schur's lemma it acts by a scalar on V. Thus to complete the proof of the corollary it 
suffices to check that tr(ey; V) = dimT^. However, it is clear that tr(ey; CH) = (dim V^)^, 
where CH is viewed as the regular representation of H. Since CH contains exactly dim V 
copies of V, the corollary follows. □ 

As a consequence, we immediately obtain the well known 

Corollary A. 3 (Orthogonality relations). The irreducible characters ofU are orthonor- 
mal with respect to the inner product on the space of C-valued functions Fun(n) o?7 U 
defined by 

Proof. In the situation above, let xv and xw denote the characters of V and W, respec- 
tively. It is clear that {xw \ Xv) = (diml^)"^-tr(ey; W), which implies that (xw \ Xv) = 
in view of the previous corollary. Similarly, {xv \ Xv) — {dimV)~^ ■ tr(ey; V) — 1. □ 

Later on we will need the following result. If V is an irreducible representation of H, we 
define /y to be the set of elements of CH that act by on every irreducible representation 
of H that is not isomorphic to V. Then /y is a minimal (nonzero) two-sided ideal of CH, 
and we call it the minimal ideal corresponding to V. 
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Corollary A.4. With the same notation, consider the linear map 

tPv ■■ Endc(l^) Cn, 
dim V , ^ 1 ^ ^, 

For each f G Endc(V^), the element tpvif) ^ CIl acts as f on V, and if W is an 
irreducible representation ofU which is not isomorphic to V , then ipvif) acts as on V . 
Consequently, ipv is multiplicative, and it maps Endc(T^) isomorphically onto ly- 

Proof. The last statement of the corollary follows from the first. The morphism CII — > 
Endc(V^) induced by the action of 11 on y is surjective, thus it suffices to prove the first 
statement for the case where / is given by the action of an element g Now 

^ tr(^7-^; V)-^ = J2 tr(^7-'; V) ■ ^g-' ■ g = ^^(7'"'; V) ■ ^' ■ g, 
7611 7en 7'Gn 

whence ipv{g) = ' g- In view of Corollary A. 2, this completes the proof. □ 

A. 2. Convolution. A special case of the following result has implicitly appeared in Sec- 
tion 2. Let us recall that under the natural identification of CII with the space Fun(n) 
(where each 7 G 11 corresponds to the delta-function at 7), the multiplication in the 
algebra CII corresponds to the convolution of functions, defined by 



(/i*/2)(7) = E/i(^)/2(^~'7)- 



hen 

Proposition A. 5. As before, letxv,Xw : 11 — > C denote the characters of nonis amorphic 
irreducible representations V and W of U, respectively. Then 

card(n) 

Xv*Xw = and xv * Xv ^ -r- — TJ- ' Xv- 

dim 1/ 

Note that this result is a strengthening of Corollary A. 3, because if /i,/2 G Fun(n), 
then (/i I /2) = (cardn)"^ • (/i * /2)(1), and on the other hand Xv(l) = dimF. 

Proof. By definition, for any 7 G 11, we have 

Since ey acts by on VF by Corollary A. 2, we see that Xv*Xw = 0. Replacing by F in 
the last computation and using Corollary A. 2 again shows that ^.^^(n) ' iXv*Xv) — Xv- D 
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A. 3. Twisted conjugacy classes. Let 11 be a finite group and (j) an automorphism of 
n. We define the (p- conjugation action of U on itself by 7 : x i— > 0(7)x7~^. (Note that 
unless (f) — idn, this is not an action by group automorphisms.) Its orbits will be called 
the (p- conjugacy classes in 11. For the purposes of Section 4 it is important to study the 
relationship between functions 11 — > C that are constant on 0-conjugacy classes on the 
one hand, and the irreducible representations of U whose characters are ^-invariant on 
the other hand. To this end, let denote the automorphism of 11 induced by 0. For every 

p e (n)"^, let us choose a realization p : H — > Aut(V^) and an automorphism 0^ of Vp such 
that-^^ p(0(7)) = (f)~^p{'y)(f)p for all 7 e 11. With this notation, we have 

Proposition A. 6. If p & i^)'^ > function Xp on U defined by Xpil) = ti'(0pP(7)) is 
invariant under (^-conjugation. Moreover, together the functions Xp form a basis for the 
space of functions on H that are invariant under (p- conjugation. 

The set of 0-conjugacy classes in 11 is naturally identified with i?^(Z, 11), where Z acts 
on n via (p. Thus we obtain the following 

Corollary A. 7. In the same situation, we have cardif^(Z, 11) = card(n)''^. 

(Note that in general there is no natural bijection between i7^(Z, 11) and (H)*^, as is 
already demonstrated by the special case (p = idn-) 

A. 4. Proof of Proposition A. 6. The proof will be included in the final version of the 
paper, but the idea is to let d denote the order of 0, consider the semidirect product 
r = n XI (Z/dZ), where Z/dZ acts on 11 via 0, and apply the standard results recalled 
above to the irreducible characters of the group F. 

Appendix B. Heisenberg representations 

Representations of finite groups of nilpotence class < 2 (in particular, of the fake 
Heisenberg groups) can be studied and classified using the following approach. In effect, 
it amounts to a special case of the orbit method; however, this case is technically simpler, 
and, historically, it was understood before the general orbit method was developed. Thus 
we prefer to discuss it independently of Section 2. 

Definition B.l. We say that an irreducible representation p : T ^ Aut(y) of a finite 
group F is a Heisenberg representation if the quotient of F by A'" = {(7 G F | p{g) G C^} is 
abelian. This amounts to the same as requiring that the image of F under p is a nilpotent 
group of class at most 2, i.e., that p([F, [F, F]]) = {idy}. 

Lemma B.2. If p is a Heisenberg representation and N is as above, the pairing 

r/NxT/N — ^C^, (B.l) 
obtained by composing p with the commutator in F, is nondegenerate. 
-"^^Note that this condition determines (j)p uniquely up to scaling. 
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Proof. Suppose that g E T is such that p{[g,g']) = 1 for all g' G F. This means that p{g) 
commutes with p(r), and so p{g) is a scalar by Schur's lemma, i.e., g & N, as required. □ 

Corollary B.3. With the same notation, the character of p vanishes outside of N . 

Proof. Let g E T, g ^ N. By the lemma, there exists 7 G F such that p{['J,g]) 7^ 1- But 
P(75'7"^) = P{b:9])p{9): and since p{[y,g]) is a scalar 7^ 1 and tr(p(75(7-^)) = tr{p{g)), 
this forces tj:(p(g)) = 0, as claimed. □ 

We denote by Heis(F) C F the set of isomorphism classes of Heisenberg representations 
of F. It is a simple exercise to show that every Heisenberg representation of F is induced 
from a 1-dimensional representation of a subgroup of F; in fact, that subgroup can be 
taken to be the prcimage of any subgroup of T/N that is Lagrangian with respect to the 
pairing (B.l). There is also a more precise description of Heis(F): 

Proposition B.4. J/F is a finite group, there is a natural bijection between Heis(F) and 
the set S(r) of pairs {v^v) consisting of a T -invariant character v : [F, F] and an 

extension u of u to the prcimage in F of the center^'' o/F/Kerz/. 

Proof. We define a map a : Heis(F) — > S{T) as follows. Given a Heisenberg representa- 
tion p : F — >• Aut(V), the subgroup p([F,F]) C Aut(V) commutes with p(F), so p([F,F]) 
consists of scalars by Schur's lemma. Thus there exists a character i/ : [F, F] — > such 
that ^(7) = 1/(7) idy for all 7 G [F, F]. It is obviously F-invariant. We have Keri/ C Kerp, 
whence the representation p factors through F/ Ker z/. Applying Schur's lemma again, we 
see that the center, Z, of F/ Ker acts by scalars on V , which determines an extension u 
of 1/ to a character of the preimage in F of Z. We put a{p) = (u, u). 

Next we define a map /3 : 5'(F) — > Heis(F). Given (z^, i?) G 'S'(F), note that the F- 
invariance of u means that [F, [F, F]] C Kerz/, so if C C F denotes the preimage of the 
center of F/ Ker i/, then [F, F] C C. In particular, F/C is an abelian group. Moreover, the 
character u determines a commutator map c,^ : F x F — > C^, (71, 72) ^ '^{[11,12]), which 
by the definition of C factors through a nondegenerate pairing c,^ : (F/C) x (F/C) — > C^. 
Let L C F/C be a Lagrangian subgroup with respect to Cj,, and let L C F denote its 
preimage. By construction, 1/ vanishes on [I/, L], whence the character z7 : C — > 
admits a (possibly non-unique) extension to a character / : L — > C^. Consider the 
induced representation p^j — Ind~ /. (We use this notation because a priori plj depends 
both on the choice of L and on the choice of /.) Let us prove three assertions: 

1) The representation p^j is irreducible. This follows immediately from Mackey's irre- 
ducibility criterion ([Se77], §7.5) and the fact that L C F/C is Lagrangian. Indeed, 
if 7 G F is an element such that fi^xj'^) = f{x) for all x E L, then / is trivial on 

^'''Notc that r acts on [r,r] by conjugation, and if a character i/ : [T,r] is invariant under 

this action, then Keiiy is a normal subgroup of T, so the quotient F/Kerzy is also a group. Hence the 
definition of <S'(r) makes sense. 
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[7, L], which means that the image 7 of 7 in F/C is orthogonal to L with respect to 
the pairing Cj/, and therefore ^ & L, i.e., 7 e L. 

2) The representation pLj is Heisenberg. This is clear because / is trivial on [F, [F, F]] 
by construction, and [F, [F, F]] is normal in F, so pij is also trivial on [F, [F, F]]. 

3) Up to isomorphism, pij depends only on u (and z/), but not on the choices of L or /. 
To see this we use the standard formula for the character of an induced representation 
([Se77], §7.2). Since C is normal in F and u : C — > is F-invariant, this formula 
implies that the restriction of tr(p£,j) to C is a multiple of v which is independent of L 
and /. On the other hand, it is clear that C = {g eV \ pijid) G C^}, whence tr(pij) 
vanishes outside of C by the previous step and by Corollary B.3. So tr^pLj) depends 
only on (z^, i^), and hence so does plj- 

This allows us to define /3 : S{T) — >• Heis(F) by = Plj with the notation above. 

Finally, it is clear that a o /3 is the identity, and the fact that /3 o a is the identity follows 
from the formula for the character of an induced representation mentioned above. □ 

Appendix C. A "reduction process" for finite nilpotent groups 

In this appendix we prove that every irreducible representation of a finite nilpotent 
group can be obtained canonically by inducing a Heisenberg representation (Appendix 
B) of a subgroup. The method of proof also yields an almost canonical construction of 
polarizations. For definiteness we will work with representations over the field C. 

C.l. Reminder on induced representations. Let F be a finite dimensional complex 
vector space and p : F — > Aut{V) an irreducible representation of a group F. We define a 
realization of p as an induced representation to be a direct sum decomposition 

V = ^V., V.^{0), (C.l) 

such that each g E T takes each Vi to some ^£,(1), where g{i) e /. Since p is irreducible, 
these conditions imply that F acts transitively on I. For the sake of naturality, we will 
not fix any particular i E I; but if one chooses i, one can easily see that p is induced from 
the representation of Fj = {gf e r|g((i) = i} in the subspace Vi. 

C.2. Reduction process for finite nilpotent groups. We claim that if p : T ^ 
Aut(y) is an irreducible representation of a finite nilpotent group V, then there is a 

canonical realization (C.l) of V as an induced representation, such that the representa- 
tion of each Fj in Vi is Heisenberg in the sense of Definition B.l. Here, "canonical" means 
"constructed without making any choices"; more precisely, given two irreducible repre- 
sentations p : F — > Aut(V^), p' : F' — > knt{V') and compatible isomorphisms : F F', 
■0 : V V , the decomposition (C.l) for V is mapped to that for V under ■0. 
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This canonical decomposition of V can be constructed as follows. Put N = {g G 
r\p{g) e C^}, and let Z be the center of F/N. Of course, unless F/N is abelian, the 
pairing (B.l) is not defined, but one always gets a pairing 

Z X (F/N) — > (C.2) 

by composing p with the commutator in F. Let Zq C. Z denote the kernel of the restriction 
of this pairing to Z x Z, and let A C F be the preimage of Zq. By construction, ^4 is a 
normal subgroup of F (because A/N is central in F/N). Moreover, p{A) is abelian. Put 
S — {x & A* \ V^^ (0)}, where is the x-eigenspace of A in V. The decomposition 

xes 

satisfies the conditions of §C.l. The following lemma shows that if p is not Heisenberg, 
then card(5') > 1, which allows us to proceed by induction. 

Lemma C.l. If p{A) C C^, then p is a Heisenberg representation. 

Proof. If p{A) C C^, then A = N, so Zq is trivial. This means that the commutator 
pairing Z x Z ^ is nondegeneratc, i.e., it induces an isomorphism Z Z* — 
Hom(Z, C^). By the definition of (C.2), this isomorphism factors through F/N, so Z 
splits off as a direct factor oiF/N. Since the center oiF/N equals Z, this implies that 
the center of {F/N)/Z is trivial. As F/N is nilpotent, this means that F/N is abelian, 
i.e., p is Heisenberg. □ 

Remarks C.2. (i) A classical theorem says that every irreducible representation of a 
finite nilpotent group F can be realized as a representation induced from a 1- 
dimensional character of some subgroup^^. However, there is no canonzca/ realization 
of this type: if p is a Heisenberg representation of F and N is as before, then the de- 
compositions (C.l) with diml^ = 1 correspond bijectively to Lagrangian subgroups 
of F /N , and it may happen that F/N has no Lagrangian subgroups stable under 
Aut(F,p). 

(ii) The previous remark is one of the reasons why we prefer to consider Heisenberg 
representations as "atoms" rather than realizing them as representations induced 
from 1-dimensional characters. There is also another reason. Namely, we hope that 
some version of the "reduction process" described above works in the geometric 
setting of unipotent algebraic groups (instead of abstract finite nilpotent groups). In 
this setting it is important to avoid having to choose Lagrangian subgroups: e.g., the 
quotient of a fake Heisenberg group (see §3.7) by its commutator has no algebraic 
Lagrangian subgroups at all, because its dimension is odd. 



■''^This follows, e.g., from the construction described above, because every Heisenberg representation 
of a finite group can be induced from a 1-dimensional representation of a subgroup, see Appendix B. 
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C.3. Reduction process for Lie rings. A construction of polarizations. We will 
describe an analogue of the reduction process of §C.2 for finite nilpotent Lie rings. It 

leads to an "almost canonical" construction of polarizations. After obvious changes our 
definitions and constructions also apply to finite dimensional nilpotent Lie algebras over 
a field^^. 

Given a finite Lie ring q, we put q* = Homz(g, C^). If / e g*, we define an alternating 
pairing Bf : g x g — )• by 

Bf{x,y) = f{[x,y]), x,y e g. 

Given an additive subgroup a C we write a"*"^ for the orthogonal complement to a with 
respect to Bf. We abbreviate g-^f as g^ . 

Definition C.3. An element / G 0* will be called Heisenberg if its restriction to [g, [g,g]] 
is trivial, or, equivalently, if [g,g\ Q g-^ ■ 

Definition C.4. A quasi-polarization for / e g* is a Lie subring aC. g which is coisotropic 
as an additive subgroup (i.e., satisfies O"*"^ C a). A quasi-polarization a at / is Heisenberg 
if the restriction of / to [a, [a, a]] is trivial. 

Let us also recall (§C.3) that a polarization for / G 3* is a Lie subring f) C g such that 
/([[),[)]) = {1} and i) is maximal among all additive subgroups of g with this property. 

The following result is obvious: 

Lemma C.5. (a) If f E g* is Heisenberg, then every maximal isotropic additive subgroup 
of g with respect to Bf is a Lie subring of g, and hence a polarization of g at f . 

(b) If a C. g* is a quasi-polarization at f, then every polarization {resp., quasi-polarization) 
for a /|q is also a polarization {resp., quasi-polarization) for g at f. 

According to this lemma, in order to prove the existence of a polarization of g at a 
given / G 0*, it is enough to show the existence of a Heisenberg quasi-polarization at /. 
We prove a stronger statement: 

Proposition C.6. Given f G g* , there exists a canonicaP^ way of constructing a Heisen- 
berg quasi-polarization O/ for g at f . The construction is compatible with the reduction 
process of^C.2; more precisely, it satisfies the condition stated below. 

Compatibility condition. Suppose that g has nilpotence class c such that c! is invertible 
on g. Let pf be the irreducible representation of F := exp g corresponding to /, and let 

be the irreducible representation of A/ := Expo/ corresponding to the restriction /|^^- 
Then p^ is Heisenberg, and since a/ is coisotropic, the orbit method [Ki62, BSx] implies 
that Ind^^ py = pf. This realization of pf as a representation induced from a Heisenberg 
representation coincides with the realization obtained in 

^'^Thesc changes are left to the reader. The only difference is in the definition of g*: if is a Lie algebra 
over a field k, then g* stands for B.oiaik{Q, k). 
^^\a the sense explained in §C.2. 
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To prove Proposition C.6, we will show that the Heisenberg quasi-polarization a/ can 
be constructed by mimicking the inductive argument used in §C.2. First, let n denote the 
maximal ideal of g that is contained in , let J = {a; e 5| [x, C n}, and let Qi — 

Lemma C.7. (i) Qi (Z Q is coisotropic with respect to Bf. 
(m) Si ^ [0,g]. 

(Hi) Qi = Q if and only if f is Heisenberg. 

Before proving the lemma, let us note that it implies Proposition C.6. Namely, the 
canonical Heisenberg quasi-polarization a/ is constructed by induction on the order of q. 
If / is already Heisenberg take a/ := Q. Otherwise, Lemma C.7 tells us that Qi is a proper 
coisotropic Lie subring of g, so the canonical Heisenberg quasi-polarization a/i^^ is defined 
by the induction assumption, and by Lemma C.5(b) we can take a/ = a/i^^ . Now let us 
prove Lemma C.7. 

Proof, (i) We have Q^^ C J-^f C Qi. 

(ii) It suffices to show that 

^[0,0], (C.3) 
i.e., that Bf{[x,y], z) = 1 for 2; G 3 and x.y G g. Write Bf{[x,y],z) as f{[[x,y],z]), apply 
the Jacobi identity, and recall that [0,3] C n C g^. 

(iii) If / is Heisenberg, then 3^ = g, and therefore gi = g. Let us prove that if gi = g 
then / is Heisenberg. This is equivalent to g/n being abehan. As g/n is nilpotent, to 
prove that it is abelian it suffices to show that its commutant has zero intersection with 
its center. Our J is the preimage of this center in g, so we have to show that if gi — Q 
then 3 n [g,g] C n. 

By (C.3), 3^n [g, g] C Jfl J-'--'' C gf^ = g-^f = gf . But J is an ideal, so Jfl [g, g] is an ideal 
contained in g-^. As n is the maximal ideal with this property, we see that Jn [g, g] C n. □ 

The following lemma shows that the construction of the quasi-polarization given above 
is compatible with the reduction process of §C.2. 

Lemma C.8. With the same notation as above, assume that g has nilpotence class c such 
that c! is invertible on g, let V = Expg, let p denote the irreducible representation of T 
corresponding to the orbit of f, and let N, Z and A be defined as in Then: 
(i) A^ = Expn; 

(a) Exp 3' is the preimage of Z in F; 
(ill) A = Exp (3 n 3^/); 

(iv) Exp(gi) is the stabilizer in F of the 1-dimensional character of A induced by f. 

Proof. The proof of (i)-(iii) is straightforward. It is also straightforward to check that the 
stabilizer in F of the 1-dimensional character of A induced by / equals Exp(g'^), where 
S'l — d^i^O^^- Finally, gi •.— i + i-^^ — gi (both gi and q[ contain the kernel g-^ of our 
alternating pairing Bf, and it is easy to show that q'i/q^ — Qi/ Q^)- □ 
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Appendix D. Vergne's construction of polarizations 

The goal of this appendix is to present in detail a construction of polarizations for 
completely solvable Lie algebras, due to Michele Vergne. The key results are Theorems 
D.4 and D.9 (see also Remark D.ll). A related result is Theorem D.6, which classifies 

vector spaces equipped with a complete flag of subspaces and an alternating bilinear form. 
We also give a reformulation of Vergne's construction (cf. §D.4) which explains why it is 
very natural from the viewpoint of representation theory of nilpotcnt groups. 

We remark that the results of this section, with the exception of those in §D.2, have 
natural analogues for finite abelian groups. In order to formulate and prove them one has 
to replace finite dimensional vector spaces V by finite abelian groups A; the dual space V* 

in the sense of linear algebra by A* = Hom(A, C^); an alternating bilinear form on V by 
an alternating bi-additivc map B : Ax A ^ C^; subspaces of codimension 1 by maximal 
proper subgroups; and arguments using induction on the dimension of V by arguments 
using induction on the order of A. We leave the details as an exercise; see also [BSx]. 

D.l. Linear algebra. Fix a finite dimensional vector space V over an arbitrary field k, 
equipped with an alternating^^ bihnear form B : V x V ^ k. li W C V is a subspace, 

we denote by W-^ its orthogonal complement in V with respect to B. One has W-^-^ = 
W + KeiB, where Kei B = V-^ is the kernel oi B. A subspace 14^ C \/ is said to 
be isotropic ii W Q W-^. In this situation, B induces an alternating bilinear form on 
W-^/W. The following result is obvious: 

Lemma D.l. Let W Q V be isotropic. If W O W' C V and W is isotropic, then 
W' C W-^ and W'/W is an isotropic subspace of W-^/W. Thus we obtain a bijection 
between the set of isotropic subspaces ofV containing W and the set of isotropic subspaces 
ofW^/W. 

Even though this terminology is usually reserved for the situations where one works 
with a symplectic form (i.e., a nondegenerate alternating bilinear form), for the sake of 
brevity we will define a Lagrangian subspace of y to be a subspace which is maximal 
among the isotropic subspaces of V , with respect to inclusion. 

Lemma D.2. A subspace L C V is Lagrangian if and only if L^ = L. 

Proof. By Lemma D.l, L is Lagrangian if and only if L C L"*- and L-^/L has no nonzero 
isotropic subspaces. The latter condition means that L-^/L = (0) (otherwise any 1- 
dimensional subspace oi L-^/L is isotropic). □ 

Lemma D.3. Let V G V be a subspace of codimension 1, and L' a Lagrangian subspace 
of V with respect to -B | ^, . 

(i) A Lagrangian subspace L CV contains L' if and only if L nV = L' . 



We recall that this means that B{v, v) = for all v G V. If char fc = 2, this condition is stronger 
than requiring B to be skew-symmetric, i.e., B{v,iu) = —B{w,v) for all VjW gV. 
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(u) There is exactly one such L, namely, L = L'^ = L'^^ = L' + Kqi B. 
{Here, L'-*- denotes the orthogonal complement of L' in V .) 

Proof, (i) If L C ^ is Lagrangian and L D L' , then LnV \s an isotropic subspace of V 
containing V . But V is maximal among isotropic subspaces of y , so L fl y = L'. 
(ii) By Lemma D.l, the Lagrangian subspaces of V containing L' correspond bijectively 
to the Lagrangian subspaces of L'^ /L' . But L' is Lagrangian in V , so L'^ r\V' = L' , so 
dim(L'-'"/L') < 1. Therefore L'^ jV has exactly one Lagrangian subspace, namely, L'^ / L' . 
So there is exactly one Lagrangian subspace L C.V containing L', namely, L — L'^. As 
L'^ is Lagrangian, L'^ = L'^^. Finally, L'^^ = L' + KerS. □ 

Assume now that V is equipped with an increasing filtration by subspaces such that 
Vq = (0), y„ = y for some n > 0, and dim(yi/V^_i) < 1 for alH > 1 (then for any 

subspace V G V, these conditions hold for the induced filtration Vi := V D Vf, this is 
the only reason why we impose the inequality dim(Vj/Vi_i) < 1 rather than the equality 
dim{Vi/Vi_i) = 1). Put By, := B\^^. 

Theorem D.4 (Vergne's Theorem 1). There is exactly one Lagrangian subspace L G V 
such that LnVi is Lagrangian in Vi for every i. Namely, L equals 

n 

L(y.,S) :=^KerSy.. (D.l) 

i=l 

Proof. Lemma D.3 allows one to proceed by induction on n. □ 

Remarks D.5. (i) It is clear that L{V,,B) is isotropic in V, but the fact that it is 
Lagrangian is nontrivial. As explained above, it follows from Lemma D.3. It also 
follows from Remark D.7 and Proposition D.8 below, 
(ii) Suppose that dim(Vi/Vi_i) = 1 for some i. Then it is easy to see that either Ker -Bvi_i 
is a codimension 1 subspace of KerSy., or KerSy. is a codimension 1 subspace of 
KerSy._i. 

The reader may prefer to skip the next subsection and go directly to §D.3. 

D.2. A classification theorem. In view of the discussion above, it is natural to study 
triples of the form (V, B, V,) consisting of a finite dimensional vector space V over k, an 
alternating bilinear form B on V, and a complete fiag of subspaces of V, 

V. : (0) = HcyiC---cV; = V^ {dimVj^j). 

Wc say that two such triples, {V, B, V,) and {V, B', V,'), arc isomorphic if there exists a 
A';-lincar isomorphism (f) : V ^ V such that B'{(f){v), (f){w)) = B{v, w) for all v,w & V and 
0(Vj) = Vf for < j < n. In this subsection wc prove 

Theorem D.6. There exists a bijection between the set of isomorphism classes of triples 
{V,B,V,) with diml^ = n, and the set of all involutions of the set {1,2, . . . ,n} , i.e., 
elements a & Sn {the symmetric group on n letters) such that — 1. 
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Let us define a basis (ei, . . . , e„) of V to be good with respect to (V,, B) if 

1) for every i, the subspace Vi is generated by ei, . . . , e^; and 

2) for each i there exists at most one j such that -B(ej, e^) 7^ 0. 



Given such a basis, let K be the set of indices i such that B{ei,ej) — for all j e 
{1, . . . ,n}. For i ^ K, let (T(i) denote the unique j such that B{e,i,ej) 7^ 0. It is clear 
that a{i) 7^ that (7(2) ^ A', and that (^((^(i)) = i. Defining (j{k) = k for all k & K, we 
obtain an involution of {1,2,..., n} whose set of fixed points is exactly K. 

Remark D.7. Given a good basis, put A = {i | a(i) > i}. Then the subspace L{V,,B) 
defined by (D.l) is spanned by the vectors Cj where i & K U A. This immediately implies 
that L{V,,B) is Lagrangian. 

Proposition D.8. (i) A good basis for {V,, B) exists, 
{ii) The involution a is uniquely determined by {V,,B). In fact, it is determined by the 
relative position of the flag V, and the (incomplete) flag formed by the orthogonal 
complements of the subspaces inV . 

Proof, (i) By induction, we may assume the existence of a good basis (e^, . . . , e'^_i) for 
Vn-i- Put Kn-i — {i < n—1 I -B(e-, e'j) — for all j < n—1}. We can choose e„ e V\Vn-i 
so that B{e'i, e„) = for i ^ Kn-i- Indeed, it suffices to pick an arbitrary e' & V \ Vn~i 
and define 



where r is the involution of {1, . . . , n — 1} corresponding to the basis {e[, . . . , e^_i). Now 
if B{e[, e„) 7^ for at most one i G Kn-i, then (e'^^, . . . , e^_^, e„) is already a good basis for 
V and we are done. If not, choose t e Kn-i with B{e[, Cn) 7^ 0, and for each i G i^n-i \ {t} 
replace with 



Theorem D.6 follows easily from this proposition. Namely, parts (i) and (ii) allow us to 
associate a well defined involution a E Sn to a triple (V, B, V,), which of course depends 
only on the isomorphism class of the triple. Moreover, if (ci, . . . , e„) is a good basis for 
{V, B, V,), then by rescaling we may assume that B{ei, ecr(i)) = 1 whenever (7(i) > i, which 
clearly implies that knowing a allows us to recover {V,B,V,) up to an isomorphism. 




It is clear that this operation produces a good basis for V. 

(ii) Let rij be the rank of the map ^ V* induced by B. Put e^j = r^j — ri^ij — Hj-i 
Ti-ij-i. Each eij equals or 1, and €ij = 1 if and only ii i ^ K and j — (T(i). 




+ 
□ 



D.3. Vergne's theorem for 2-cocycIes. 
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Theorem D.9 (Vergne's Theorem II). In the situation of Theorem D.4, suppose that V 
is a Lie algebra over k, each Vi is a Lie ideal ofV, and B is a 2-cocycle, i.e., 

B{[x,ylz) + B{[y,zix) + B{[z,xU) =0 Vx,y,z e V. (D.2) 

Then L — I/(V,, S) is a Lie subalgebra ofV. 

Proof. It is easy to deduce from (D.2) that [Ker Bvi,KeT By ] C Keri?y. for all 1 < i < 

j <n. r J ^ ^ 

If B is the coboundary of / e V*, i.e., if B{x,y) = f{[x,y]), then Theorem D.9 says 
that L{V,, B) is a polarization of V at /. The existence of a complete flag of ideals 
means by definition that V is completely solvable^^. So one obtains the following 

Corollary D.IO (M. Vcrgne). Let V be a finite- dimensional Lie algebra over a field. If 
V is completely solvable, then every f & V* admits a polarization. 

Remark D.ll. It is known (even when V is nilpotent) that not every polarization for / 
can be obtained by Vergne's construction from some complete flag of ideals of V. 

Remark D.12. The main reason why we prefer to formulate Theorem D.3 for any 2-cocycle 
B rather than in the particular case where B is a coboundary is that the proof becomes 
more transparent. In fact, Theorem D.3 follows from this particular case because if 

is the central extension corresponding to B then the pullback of -B to y is a coboundary. 

On the other hand. Theorem D.13 below, which is an analog of Theorem D.3 for 
associative algebras, does not seem to follow from the case where S is a coboundary. 

Theorem D.9 has the following analog for associative algebras, which we learned from 
Carlos A. M. Andre's article [And98] (see Proposition 5.1 in the electronic version). 

Theorem D.13. In the situation of Theorem D.4, assume that V is an associative algebra 
over k, each Vi is a two-sided ideal ofV, and B satisfies the identity 

B{xy,z) B{yz,x) + B{zx,y) ^0 yx,y,zeV. (D.3) 

Then L is a {multiplicatively closed) subalgebra ofV. 

Proof. It is easy to deduce from (D.3) that for all 1 < i < j < n we have (Keri?y.) • 
(Ker Bv^ ) C Ker Sy, and (Ker By^ ) ■ (Ker By ) C Ker Ey. . ' □ 

Remarks D.14. (i) Condition (D.3) implies (D.2). 
(ii) The space of alternating forms BonV satisfying (D.3) contains the subspace of 
forms B{x,y) = f{xy — yx) for / G V*. The corresponding quotient space is dual 
to the degree 2 cyclic homology^^ of the associative algebra V . 

^^We recall that every nilpotent Lie algebra is completely solvable; every completely solvable Lie 
algebra is solvable; and over an algebraically closed field every solvable Lie algebra is completely solvable. 
^^We warn the reader that the space dual to cyclic homology is quite different from cyclic cohomology. 
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In the next subsection we will need the following fact. The proof is completely obvious. 

Lemma D.15. (i) Suppose that V is a Lie algebra and B is a 2-cocycle. Then the 
orthogonal complement of an ideal I QV with respect to B is a Lie subalgebra ofV. 
(a) Suppose that V is an associative algebra and B satisfies (D.3). Then the orthogonal 
complement of a two-sided ideal I C.V is a multiplicative subalgebra ofV. 

D. 4. Recursive procedure. Let V, and B be as in Theorem D.4. Let k be an index 
such that Vk is isotropic. Put V := V^, Vi:^Vn Vi, B := B\V. 

Lemma D.16. (i) In this situation, L{V,,B) — L{V,,B). 

(a) If V is a Lie algebra, each Vi is an ideal, and B is a 2-cocycle, then V is a Lie 

subalgebra ofV, each Vi is a Lie ideal ofV, and B is a 2-cocycle for V. 
{Hi) If V is an associative algebra, each Vi is a two-sided ideal of V , and B satisfi,es 
(D.3), then V is a multiplicative subalgebra ofV, each V^ is a two-sided ideal ofV, 
and B satisfies (D.3) with V replaced by V . 

Proof, (ii) and (iii) follow immediately from (i) and Lemma D.15. Let us prove (i). 
It is clear that L{y„B) 3^14, so L{y„B) C V^ = V. For every i, it follows that 
L{V„ B)r\Vi = L{V„ B)nV nVi = L{V„ B) n Vi is Lagrangian in V^ by Theorem D.4, 
and hence, a fortiori., is Lagrangian in Vi. Using Theorem D.4 again, we conclude that 
L{V.,B)^L{V„B). □ 

Lemma D.16 gives a recursive procedure of finding L(y,, B). To see this, note that if 
S = 0, then L(y,, B) — B, and if 5 7^ 0, then there exists k such that 14 is isotropic but 
Vk ^ Ker5, so V :— V^ is not equal to V. (The minimal k such that T4 ^ Ker B has 
this property.) 

Now assume that K is a Lie algebra, each Vi is an ideal, and B{x,y) = f([x,y]) for 
some / e V*. Then the above recursive construction of L{y,,B) can be reformulated as 
follows, li f e V* is y-invariant (i.e., if / is a Lie algebra character), then L{V,,B) is 
V itself. Otherwise there exists k such that fk :— f\y^ is a Lie algebra character, but 

fk is not invariant with respect to the action of V on V^. Let V C V he the stabihzer 
of fk. Now replace V by V, f by /|^, and V hj Vi nV. When formulated this way, 
the recursive procedure is completely parallel to the classical one used to prove that any 
irreducible unitary representation of a unipotent group over M (or of a finite nilpotent 
group) is induced from a 1-dimensional character of a subgroup. 

Appendix E. Equivariant derived categories 

E. l. Derived categories of constructible complexes. Let k be an arbitrary field, 
and X a separated scheme of finite type over k. Given a prime £ different from char k, 
one knows how to associate to X a triangulated category Dl{X, Q^), the bounded derived 
category of constructible complexes of i-adic sheaves on X. Originally this was done for 
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k finite or algebraically closed (see, e.g., [De80]). For an arbitrary perfect field /c, the 
construction of Q^) is given in [Ek90]. Finally, if k is not perfect, we simply put 

where k^'^^-^ is a perfect closure of k (see [Gr65]), i.e., the minimal perfect subfield of k 
containing k. (The motivation for this definition is that -D^(X, Qg) should only depend 
on the etale topos of X, which does not change if we pass from X to X iSik k^^'^^.) 

In this article we will write ^{X) in place of Dl(X, Q^) to simphfy the notation. Also, 
we will refer to an object of Si[X) simply as an £-adic complex on X. The prime £ different 
from the characteristic of the ground field will be fixed throughout the discussion. 

If M G ^{X) and G Z, we will denote by M[d] the complex obtained by shifting M 
d places to the left. The functor M \ — > M[d] is an autoequivalence of ^{X). Another 
important autoequivalence is provided by the Tate twist. It is defined as follows. For 
each r e N, we have the locally constant etale sheaf //^r- on X given by 

,_igr{U) = G r{U, Ou) I f = 1} for every etale U — > X. 

Note that /i^r is naturally a sheaf of Z/£''Z-modules. Moreover, we have the sheaf mor- 
phisms /i^r — > iJ>ir-i given by ^ i — > which are compatible with the module structures 
and the obvious quotient maps 'Ljt'L — > X/f^^'L. Hence we obtain a projective system 
|/ifr|^^_^, which determines a lisse Z^-sheaf /i^oo = X^il). Extending scalars to or Q^, 

we obtain the sheaves 0^(1) and 0^(1) on X, called the {first) Tate twists. 

The sheaves Qe{l) and Qf(l) are invertible (with respect to the usual tensor product 
on £-adic sheaves), and their inverses arc denoted by Qi^^l) and Q^(— 1), respectively. If 
n G N, we define Q^(n) = Qe{l f and Qi{-n) = Qi{-lf\ and we put Q^(0) = (Q^)^, 
the constant Q^-sheaf of rank 1 on X. Similarly, Qg{n) is defined for all n G Z. More 
generally, given M G ^{X), we put M(n} = M Qe{n); this is called the n-th Tate 
twist of M. Note that if k is algebraically closed, then each of the etale sheaves Hfr 
in the definition above is already constant, and hence Z£(l) = {Z,g)x- Qe{^) — {'Qe)x- 
Q£(l) = (Q^)^ are all constant as well. However, even in this case tlic Tate twists do not 
have canonical trivializations. 

E.2. Grothendieck's six functors. We now briefly review a useful formalism for work- 
ing with the categories of £-adic complexes. However, we warn the reader that for sim- 
phcity we drop the decorations "i?" and "L" from the notation for all the functors we 

L 

consider. Thus, for instance, we denote by (g) what is usually denoted by (8), and so on. 

Let k and £ be as above, and let f : X — )• y be a morphism of separated schemes of 
finite type over k. One can define four exact functors: 

/. : ^{X) 9{Y), f* : ^(y) ^{X\ 
/i : 9{X) S>{Y) and /' : S'{Y) S'{X), 
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called the pushforward, puUback, pushforward with proper supports, and extraordinary 
pullback, respectively. The pairs (/*, f^) and {f\, /') are adjoint pairs of functors; in other 
words, /* is left adjoint to and /' is right adjoint to f\. We note also that there is 
always a natural morphism of functors f\ — > which is an isomorphism whenever / is 
proper. On the other hand, if / is smooth of relative dimension^'^ d, then /' = f*[2d]{d). 

There are also two exact bifunctors, 

: ^{X) X ^{X) — > ^{X) and K : ^{X) x ^{Y) — > ^{X x Y), 

called the tensor product and the exterior tensor product, respectively. They are related 
to each other as follows. Let p : X xY — > X and q : X xY — > Y be the two projections. 
Then M K TV ^ p*(M) O q*{N) canonically for all M e ^{X), N e ^{Y). On the other 
hand, consider the special case X — Y, and let Ax : X — )• X x X denote the diagonal 
embedding. Then M N ^ A*x{M M N) for M,N e 9{X). 

The bifunctor (g) makes ^{X) a symmetric monoidal category with unit object (Q^)x- 
Moreover, it turns out that Si{X) is closed, i.e., it has inner Homs. In other words, we 
have a bifunctor 

M'om : ^{XyP X &{X) — ^ &{X) 
and trifunctorial isomorphisms 

Hom(K ®M,N)^ Ylom{K, J^om{M, N)) for all K,M,N e ^{X). 
The "six functors" referred to in the title of this subsection are /*, /*, f\, f \ ®, J^om. 

E.3. Verdier duality. In the situation above, let X be a separated scheme of finite type 
over k, and let a : X — > Spec A; denote the structure morphism. We define Kx := a'Q^ 
and call it the dualizing complex of X. In the special case where X is smooth of relative 
dimension d over k, it follows that = Q,([2d]{d). We define the Verdier duality functor 

by Dx(M) = ^om(M, Kx). There is a natural morphism of functors Id^(x) — ^ o 
Dx which is known to be an isomorphism; in particular, Dx is a triangulated^^ anti- 
autoequivalence of &{X). If X is smooth of relative dimension d over k, we see that 
Dx(M) ^ J^fom{M, (Q^)x)[2ci](d) for all M e ^{X). 

E.4. Formalism of the six functors. The six functors introduced above enjoy a number 
of useful properties. We will list a few of them that arc implicitly used in the computations 
appearing in this paper. Everywhere below we let A;, £ be as above, and we let / : X — > Y 
denote a morphism of separated schemes of finite type over k. 

(1) Duality and tensor product: we have Dx(M ® N) = J^fom{M,I])xN), bifunctorially 
with respect to M, e ^(X). 



'This means that / is flat and its geometric fibers are regular and have dimension d everywhere. 
'This means that Djc commutes with shifts and takes distinguished triangles to distinguished triangles. 
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(2) Each of the functors /*, /*, f\, f commutes with Verdier duahty; also, if M G &{X), 
then Dx(M(n)) ^ (DxM)(-n) for all n e Z. 

(3) Projection formula: we have f\(^{f*L) M) = L (g) f\M, bifunctorially with respect 

to L e ^{Y), M e ^{X). 

(4) We have 

jeomY{fiM,N) = f\,^omx{M,fN), 
bifunctorially with respect to M G Si{X), N G ^{Y), and 

f\^omy{K,L) = J^omx{rK,fL), 

bifunctorially with respect to K,L E S>(Y). 

(5) Proper base change theorem: Given a cartesian diagram of separated schemes of finite 
type over k 

f 

tt' 

y — 

there is a natural isomorphism f*Tr\M — ^ 7r[/'*M for every M G ^{X'). 

(6) Smooth base change theorem: Given a cartesian diagram as above where / is smooth, 
there is a natural isomorphism /*7r*M 7r^/'*M for every M G ^(X'). 

(7) Verdier duality theorem: We have an isomorphism of functors 

o Dx = Dy o /, : ^{XyP — > S>(Y). 

(8) Similarly, we have /* o Dy = o /', Dy o ^ /, o and o /* ^ /' o Dy. 

E.5. Convolution. Convolution of functions on a finite group defined in §A.2 has an 

analogue for £-adic complexes on an algebraic group. Let G be an algebraic group over 
a field k (i.e., a reduced group scheme of finite type over k). Then G is automatically 
separated, so ^{G) is defined. Let ji :G xG — > G denote the multiplication morphism. 
With this notation, we define the convolution bifunctor for G, 

by the formula 

It makes ^{G) a monoidal category (which is not braided unless G is commutative) with 
unit object 1 :~ h{Qe) = l*(Qf), the delta-sheaf at the identity element of G, where by 
abuse of notation we write 1 : Spec k — > G for the morphism which defines the identity 
in G, and denotes the constant sheaf of rank 1 on Spec k. 



•^^To be more precise, it has two analogues: "convolution with compact supports" *!, which is the 
only kind used in our paper and which we therefore call simply "convolution" and denote by *, and 
"convolution without compact supports" defined by M A'' = /i*(M Kl A''). 
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E.6. Categories of equivariant objects. Let G be an algebraic group over a field k 
acting on a separated variety X (i.e., a separated reduced scheme of finite type) over k. 
Write a : G X X ^ X for the action morphism and n : G x X ^ X for the projection. 
If £ is a prime different from char A;, as usual, one would like to have the notion of the 
"equivariant derived category" ^q^{X). The correct approach to the construction of 
&Q^{X) is developed in the book [BL94], which explains our notation; we say a few 
words about it in §E.7 below. In this subsection we introduce a more naive definition 
which turns out to be equivalent to the one studied by Bernstein and Lunts when G is 
unipotent (but not for other types of algebraic groups), see Proposition E.2. 

Definition E.l. We define ^0g{X) to be the category of pairs of the form (M, 0), where 
M G ^(X) and : a*M 7r*M is an isomorphism in ^(GxX) satisfying the following 
two conditions. 

(a) If /X : C X G — > G is the product in G and 7723 : GxGxX^GxX is the projection 
along the first factor G, then 

7r*3(0) o (idc xa)*(0) = (/X X idx)*(0). 

More precisely, the two compositions of natural isomorphisms 



(idc xaya*M = {fi x idx)*a*M ^^^''^^^''W , x idx)*7r*M = 7r2>*M 



and 



(id(3 xa) a M > (idg xa) tt M = TTggO; M > 773377 M 



are equal. 

(b) If 1 : Spec k ^ G is the morphism defining the identity in G and 1 x idx : X ^ Gx X 
is the induced A;-morphism, so that q;o(1 xidx) = idx = 7ro(lxidx), then {lxidx)*{4>) 
is the natural isomorphism 

(1 X idx)*a*M = M = (1 X idx)*7r*M 

A morphism of objects (M, 0) [N, ip) in ^g(X) is defined as a morphism v : M ^ N 
in ^(X) satisfying o q;*(z/) = 7r*(z/) o ip. 

In general, the category ^g(X) is not triangulated (however, it is triangulated when 
G is unipotent by Proposition E.2). Nevertheless, it obviously inherits many structures 
from ^(X). For example, we have the shift functors (M, 0) 1— > (M[n], 0[n]) on ^g{X) for 
all n E Zi. It is also obvious that if Y is another separated variety over k with a G-action 
and / : X ^ y is a G-equivariant morphism, then /* : ^(Y) ^(X) can be lifted to a 
functor /* : ^c(y) ^0q{X). On the other hand, we have cartesian diagrams 

GxX^^^^GxY and GxX^^^^GxY 

1 / A 1 / A 
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where ax, ay are the action morphisms and ttx, Try are the projections, so the proper base 
change theorem (see §E.4) imphes that /i : ^{X) ^{Y) hfts to a functor /i : ^ci^) 
S^aiy)- Furthermore, ay and Try are smooth morphisms (because G is reduced), so the 
smooth base change theorem (see §E.4) imphes that /* : ^{X) ^{Y) also hfts to a 
functor : !^g{X) !^g{Y). 

These remarks imply that if q is another algebraic group over k, and we are given 
an algebraic action of C on g by group automorphisms, then the convolution bifunctor 
* : ^(q) X ^(g) ^(q) defined in §E.5 lifts to a bifunctor ^g(q) x ^oid) ^ ^g(q), 
which we also denote by *. 

Finally, wc have a forgetful functor ^g{X) ^{X) given by (M, 0) i-* M. If G is 
connected and unipotent, this functor is exact and fully faithful by Proposition E.2. 

E. 7. Relation with the Bernstein-Lunts approach. In this subsection we show that 
for unipotent groups G our naive definition of ^g{X) agrees with the "scientific" one 
introduced by Bernstein and hunts in [BL94]. If G is an algebraic group over a field k 
and X is a separated variety over k, we will write ^g^{X) for the G-equivariant bounded 
derived category of constructible complexes of £-adic sheaves on X defined in op. cit. It 
is a triangulated category equipped with an exact forgetful functor f : S'g^{X) ^{X). 

Proposition E.2. Let G be a unipotent group over a field k, and X a separated variety 
over k. Let £ be a prime different from char k, and let ^^g{X) be as in Definition E.l. 

(a) There is a natural equivalence of categories between ^g{X) o,i^d ^g^{X) which com- 
mutes with shifts and is compatible with the forgetful functors ^g{X) ~^ ^i^), 
^G^{X) &{X). In particular, ^g{X) is triangulated. 

(b) If G is connected, the forgetful functor SfGiX) — > ^{X) is fully faithful. 

The proof will be included in the final version of the article. 

Appendix F. Duality for perfect commutative unipotent groups 

In this appendix we return to the setup of §1.7 and explain the Serre duality theory 
for perfect connected commutative group schemes over a perfect field of positive charac- 
teristic. This theory was already mentioned in §1.7. It is used in the orbit method for 
unipotent groups of small nilpotence class, because it allows one to define the dual of 

the Lie ring scheme associated to such a group and study the geometric properties of the 
coadjoint action. Wc follow [Sa96], §1.4, since that work is written in a language best 
suited for our purposes. We note that Saibi, in turn, refers to Begueri's work [Be80]. 

F. l. Perfect schemes. To define the duality functor, one realizes Ck as a full subcategory 
of the category of perfect group schemes over k. We explain this theory below. 

Recall that a scheme S over Fp is said to be perfect if the absolute Frobenius morphism 
$ = ^s,p ■ S ^ S defined in §1.2 is an isomorphism. Let »Schp be the category of Fp- 
schemes and ^Sch^^^-'^ C «Schp the full subcategory of perfect schemes. The embedding 
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Schp'^'^'-' ^ Schp has a right adjoint Schp — s> Sch^'^'^', called the perfectization functor and 
denoted S i— > S^^'^^ . As a topological space, S^^'^f — S, and the structure sheaf of S'^^^^ is 

the inductive hmit oi Og ^ Os ^ ■ ■ ■ ■ Equivalently, SP^'-f ^ ]im{S ^ S ^ ). 

We refer the reader to [Gr65] for more details. 

A /c-scheme is said to be perfect if it is perfect as an Fp-scheme. The perfectization of 
any A;-scheme is a perfect /c-scheme. A perfect group scheme over k is a group object in 
the category of perfect /c-schemes. This is the same^^ as a group scheme over k which is 
perfect as a scheme. 

If G is a group scheme over k, then QP^^'f is a perfect group scheme over k. The relative 
Frobenius morphism G — > G^^ induces an isomorphism between the perfectizations. So 
we get a functor G i— > Gp^'^^ from the category Ck defined in §1.7 to that of perfect group 
schemes over k. It is fully faithful. The category of connected commutative unipotent 
quasi-algebraic groups over k, which we denote by is the essential image of this functor. 

F.2. Definition of G*. We still keep the assumption that k is perfect^^. If G is any 
commutative group scheme over k, we first define G* as a functor on the category of 
perfect schemes S over k by the formula 

G*{S)^E^t\GxS,QM, (F.l) 

where Ext^ is computed in the category of commutative group schemes over S and Qp/Zp 
is viewed as a discrete group scheme over S. 

One can prove (see [Be80] and [Sa96], Theoreme 1.4.1) that if G G then G* is 
representable by an object of C^, which we also denote by G*. Moreover, the functor 
G 1-^ G* is exact and involutive on the category C^. Note that the perfectness of S is 
essential for formula (F.l) to hold, see Remark (iii) below. 

Remarks F.l. (i) The RHS of (F.l) equals Ext^(G x S,p-''Zp/Zp) for any n e N such 
that G is annihilated by p"^. 

(ii) If G e Cfe, then for any perfect /c-scheme S, one has G{S) — Gp^'^^{S) and 

Ext^(G X -5,Qp/Zp) = Ext^(G*'^^-^ x ,S,Qp/Zp). 

So (F.l) still holds if G or G* is considered as an object of Ck- 

(iii) Define the coperfectization X'^°p^^^ of an Fp-scheme X to be the ind-scheme 

■^coperf ._ u j-j^5) ^x/k ^ ^(p) xM/k ^ . . . ) ^ 

where "lim" denotes the inductive limit in the category of sheaves of sets on the 
category of schemes over k with the fppf topology. If G is a group scheme over 

^^If k is not perfect, then a group object in the category of perfect fc-schemes is a group scheme not 
over k, but over its perfect closure k^^^^ . 

^^It is harmless because the category Ck defined in §1.7 does not change if k is replaced by k'^^^^ . 
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k, then Gcoper/ -g group object in the category of /c-ind-schemes. We claim that 
if G e Ck, then the RHS of (F.l), viewed as a functor on the category of all k- 
schemes S, is ind-representable by (^Q*Y°p^'^f where G* is considered as an object 
of Ck- This is a formal consequence of the equality (F.l) for S^'^^^ and the equality 

Ext^(G' X 5,Qp/Zp) = Ext^(G' X SP^'-f ,Qp/Z.p). 

F.3. Finite fields. Now let k = ¥q. We will explain why the commutative unipotent 
quasi-algebraic group G* defined by (F.l) solves the problem posed in §1.6. Namely, the 

group G*(F) can be naturally identified with the group G(F) (we recall that the latter is 
the direct hmit of the Pontryagin duals G{¥qn)* with respect to the base change maps 
defined in §1.5). This follows from the next proposition. We were unable to find exactly 
this result in the literature, therefore we provide its proof; however, the idea is essentially 
contained in [La56], even though Lang did not formulate it in the same way. 

Proposition F.2. Let G be any connected commutative algebraic group overFg. Let A 
be a finite abelian group. Then the morphism Hom(G(Fg), A) — >• Ext^(G, A) arising from 
the short exact sequence 

G(F,) G G ^ 

is an isomorphism. 

Proof. We have Hom(G', A) = because G is connected. To show that the morphism 
Ext^(G, A) — > Ext^(G, y4) induced by <l>g — id : G — > G equals 0, we note that for any 
extension 0— s>G— s>G— s>0, the morphism <l>g — id : G — > G annihilates A. □ 

F.4. Another point of view. In practice, it is sometimes a little more convenient to 
work with usual algebraic groups rather than with perfect quasi-algebraic groups. The 
only drawback of this approach is that the Serre dual is no longer defined up to canonical 
isomorphism. In this subsection we briefly explain how to define all the objects we wish 
to work with without passing to perfectization. 

As before, let /c be a perfect field of characteristic p > 0. 

Definition F.3 (cf. [Sa96], Definition 1.5.1(ii)). A dual pair of unipotent /i;-groups is a 
triple {G,G',S), where G and G' are connected commutative unipotent algebraic groups 
over k, and £ is a Qp/Z^-torsor over G' x G with the property that the induced Qp/Zp- 
torsor S^^'^^ over {G')'^^'^^ x G'^^'^^ is the universal family of central extensions of G^^''-^ by 
Qp/Zp parameterized by (G')^^^-'^, and in particular identifies (G')^^''-^ with {GP""-^)*, the 
Serre dual of G^^^f , defined as in §F.2. 

Remarks F.4. (1) The definition above makes sense because if is a connected algebraic 
group and A is a finite discrete abelian group, the forgetful functor from the groupoid 
of central extensions of if by A to the groupoid of A-torsors over IL is fully faithful. 
Thus, for an 74-torsor over if, being a central extension is a property rather than an 
extra structure. 
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(2) If G is a connected commutative unipotent algebraic group over k, then there always 
exists a dual pair (G, G', £). Indeed, one can take G' to be any algebraic group over 
k with {G'y^''f ^ {G^^^'fy, which exists because (G^"^^-^)* G and use a general 
fact ([SGA4], expose VIII): if X is a scheme over k and A is a finite discrete abelian 
group, the natural functor from the groupoid of A-torsors over X to the groupoid of 
A-torsors over X^^'^f is an equivalence of categories. 

(3) The dual pair above is non-unique because there are many different choices for G': 
for instance, one can always replace G' by (G')^^\ However, once G' is chosen, the 
previous remark shows that the torsor S is uniquely determined. 

We now prove a general result. 

Proposition F.5. Let G be an affine algebraic group overk, let X be an affine scheme of 
finite type over k, and let Z = X^^'^^ Given an action ofG^'^^^ on Z , there exists an affine 
scheme Y of finite type over k, an action of G on Y , and an isomorphism Y^^^^ = Z 
which induces the given action of G^^^^ on Z. 

Proof. Let us write G = Spec A and X — SpecS, where A and B are finitely generated 
/c-algebras. Note that ^4 is a Hopf algebra. Moreover, the G^^^'-'^-action on Z amounts to 

a fc-algebra homomorphism u : B^'^^^ — > y[perf j^perf ^\^[q[^ makes B^^^-^ a comodule 
over A^'^'^f . It is well known and easy to check that any comodule over any coalgebra 
is a filtered union of finite dimensional sub-comodules. In particular, since B is finitely 
generated over k, there exists a finite collection of elements 6i, . . . , 6^ £ B^'^'^^ such that 
the image of B in B'^'^^^ is contained in G := . . . , 6^] and 

N 

i'{hj) = Qij ^bi, 1 < J < r, for some e A^'^^-^. 

i=l 

We have A C A^^^^ (recall that our algebraic groups are reduced by assumption) , and by 
definition, there exists m e N such that a^j e A ior ell 1 < i < N , 1 < j < r. Thus u 
restricts to a /c-algebra homomorphism ui : G^"" — A (8)^ G^"". Now put Y = SpecG^"'. 
Then Y is an affine scheme of finite type over k, and Ui defines an action of G on Y. 
In addition, since G^" contains the image of in 5*"^''^, it is clear that the inclusion 
Qp"" ^ j^pe^rf ijiduces an isomorphism [C^'^Y'^^^ — ^ j^P'^rf ^ proof is complete. □ 

Corollary F.6. Let G be a connected unipotent group over k whose nilpotence class is 
< p — chaxk, and let Q — LogG, as in ^3 J. Then there exist a dual pair {q,q',S) of 
unipotent k-groups and an action of G on q' by algebraic group automorphisms which 

induces the canonical action of G^^"^^ on {q'Y^"^^ = {g'^'^^^)* . Moreover, 8 has a natural 
G-equivariant structure with respect to the induced action of G on q' x q. 

Proof. The first statement is a special case of Proposition F.5. The second one follows 
formally from the first one. Indeed, since G^^*"-^ acts on q^'^^-I' by group automorphisms, it 
follows from the universal property of S^^^^ that it has a canonical G^®'''^-equivariant struc- 
ture. This structure amounts to an isomorphism between act* EP^'^f and pr*£^^^''-^ satisfying 
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a certain compatibility condition, where act : G^^'^^ x {q'Y^'^^ x q^^'^^ — > [Q'Y^'^f x q^^"^^ 
is the action morphism and pr : G^^^^ x {q'Y^^^ x qp^'^^ — > {q'Y^^^ x g^^^-^ is the pro- 
jection. However, by the first statement of this corollary, act is the perfectization of a 
morphism G x x g — > g' x g, and of course, pr is the perfectization of the projection 
G X g' X g — > g' x g. Using the fact stated in Remark F.4(2), we see that 8 has a 
unique G-equivariant structure which induces the canonical GP^^-^'-equivariant structure 
on SP^^L □ 

Appendix G. Fourier-Deligne transform 

G.l. Fourier transforms. The Fouricr-Dclignc transform was introduced by P. Dclignc 
in [De76]. Its definition can perhaps be motivated by the usual Fourier transform. If / 
is an L} function on R with respect to the Lebesgue measure, its Fourier transform is a 
function on "a different copy of R" defined by 

/oo 
f{x)e-'^^dx. 
-oo 

Observe that e~*^^ is a "universal unitary character of M", in other words, the map 
I — > {x I— e~*^^) identifies IR with the Pontryagin dual of M (as a topological group). 

Moreover, the passage from / to / can be thought of as consisting of three steps: 

1) Consider / as a function of two variables, ^ and x, i.e., pull / back by the second 
projection p : R x R — > R (where the coordinate on the first copy of R is denoted by 
^ and that on the second copy is denoted by x) . 

2) Multiply j9*(/) by the "universal character" e~*^^. 

3) Integrate the result along the fibers of the first projection p' : M x M — > R. 

Each of these operations has an obvious analogue in the world of £-adic complexes. 
The only problem is that "integration along the fibers" has two analogues for (complexes 
of) sheaves: the !-pushforward and the *-pushforward (see §E.2). Fortunately, these two 
choices give equivalent definitions of the Fourier-Deligne transform. This is one of its key 
properties (see §G.3 below), and is the main result of [Sa96]. 

Definition G.l. Let /c be a perfect field of characteristic p > 0, let ^ be a prime different 
from p, and let (G, G', 8) be a dual pair of unipotent /c-groups as in Definition F.3. Fix an 
injective homomorphism of abelian groups C, : 'Q^p/'Lp ^ , and let £ denote the local 
system on G' x G associated to 8 via the homomorphism (. Consider the projections 

G' ^G' xG -^G. 
The Fourier-Deligne transform associated to the data {G,G',8X) is the functor 

: ^(G) — > ^{G') 

defined by 

J^(M) = pr;(pr*(M) (g) £)[dimG]. 
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Remarks G.2. (1) Strictly speaking, we have not one Fourier- Deligne transform, but a 

family of such transforms, parameterized by all possible embeddings C, ■ Qp/Zp ^ Q^^- 
However, throughout this paper we fix ( once and for all, and so we speak of "the" 
Fourier- Deligne transform. 

(2) It was already known to Dclignc [De76] that JF is an equivalence of categories. 

(3) We get an isomorphic functor if we replace pr( with pr'^ in the definition above: see 
Theorem G.6. The first proof of this fact was pubhshed by Saibi [Sa96]. 

(4) The shift [dimG] appears in the definition above to ensure that takes perverse 
sheaves to perverse sheaves: see Corollary G.8. 

G.2. Perverse sheaves. Before discussing the properties of the Fourier-Deligne trans- 
form, we briefiy recall the definitions and a few basic facts from the theory of perverse 
sheaves; we refer the reader to [BBD82] for the details and for more information. 

We only work with perverse sheaves for the self-dual (or middle) perversity. Let k be 
a field and £ a prime different from char k, as in Appendix E. Given a separated scheme 
X of finite type over k, we define a t-structure on the triangulated category ^{X), called 
the perverse t-structure, as follows. The full subcategory ^^-^{X) C Si[X) consists of all 
complexes K such that dimsupp 7i*(i^r) < —i for all i G Z, where W{K) denotes the i-th 
cohomology sheaf of K, and supp W{K) is its support, which is a constructible subset of 
X. In particular, if X e p^^^{X), then WiK) = for all i > 0. We also define 

P^^^{X) = Dx(^^-°(X)), Perv(X) = n 

(This is not exactly the same as, but is equivalent to, the definition given in [BBD82].) 
The full subcategories p^-^{X) and ^'^-°(X) define a t-structure on X (see op. cit., 
§2.2), and Perv(X) is its heart. It is an abelian category whose objects are called perverse 
sheaves on X. By definition, Perv(X) is stable under Dx- One knows that every perverse 
sheaf on X has finite length (op. cit, Theoreme 4.3.1(i)). The following result {op. cit, 
Theoreme 4.1.1) is essentially due to M. Artin: 

Theorem G.3. If f : X — ^ Y is an affine morphisrn of separated schemes of finite type 
over k, the functor : &{X) — > 9{Y) takes p^^%X) into p&^^{Y). 

In view of the Verdier duahty theorem (see §E.4), we immediately obtain 

Corollary G.4 {op. cit., Corollaire 4.1.2). Under the same assumptions, the functor 

/. : 9{X) — > &{Y) takes p^^^\X) into p^^^{Y). 

G.3. Properties of the Fourier-Deligne transform. Until Proposition G.ll we fix 
{G, G', S, as in Definition G.l, and we will write d = dimG = dimC. 

Theorem G.5 (P. Deligne, [De76]). The functor J- : ^{G) — > ^{G') is an equivalence 
of categories, and a quasi-inverse functor is given by N i — > {i*J^'N){d), where {d) denotes 
the d-th Tate twist, l : G ^ G is the inversion map x i— > —x, and T' : S>{G') — > S>{G) 
is also a Fourier-Deligne transform, defined by 

J^'(N)^pr,{(pr'*N)0jC)[d]. 
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A published proof of this result is given in [Sa96], Theoreme 2.2.4.1. 

Theorem G.6 (M. Saibi). If J^, : ^(G) — > ^{G') is defined hy T^{M) = pr',((pr*M) O 
£) [d], then the functors and T are naturally isomorphic. 

This theorem was conjectured by Deligne, and is one of the main results of [Sa96]. 
However, we will sketch a proof which is much shorter than the one appearing in op. cit., 
following an argument explained to us by Dennis Gaitsgory^^. In view of Theorem G.5, 
to prove that the functor JF^ is isomorphic to J^, it suffices to show that JF^ is right 
adjoint to the functor i — > {l* J-'' N) (d) . However, this can be done by a straightforward 
computation which is based on the fact that if A, B are functors between arbitrary 
categories such that the composition A o B \s defined, and A', B' are functors right 
adjoint to A and B, respectively, then B' o A' is right adjoint to Ao B. 

For the reader's convenience, we provide a detailed computation. Given M e &{G) 
and N e Si{G') , we have a chain of bifunctorial isomorphisms 

Hom((t*:r'Ar)((i), M) ^ Hom(pr,((pr'*Ar) ^ {i^M){-d)) 

^ Hom(((pr'*Ar) ® pr(i,M)(-d)) 

^ Hom(((pr'*Ar) ® pr*(t,M)[2d]) 

^ Hom((pr'*Ar) ^ pr*(i,M) [d]) 

^ Hom((pr'*A^) (g) C, (id^ Xi)*pr*(M)[d]) 

^ Hom((idG' Xi)*((pr'*A^) £), pr*(M)[d]) 

^ Hom((idG' Xi)*(pr'*Ar) ® (idc xt)*jC, pr*(M)[d]) 

^ Hom((pr'*A^) ® C'^ pr*(M) [d]) 

^ Hom(pr'*Ar, (£ ® pr*(M))[ci]) 

^ Hom(iV,pr;((pr*M) 

The justifications of these isomorphisms are mostly trivial. The third one follows from 
the fact that pr is a smooth morphism of relative dimension d. The seventh one, which 
amounts to (idc' xl)*C = C~^, follows easily from the universal property of the Qp/Zp- 
torsor 8 over G' x G. This completes the proof of Theorem G.6. 

Corollary G.7 (Fourier-Deligne transform commutes with duality). There exist functo- 
rial isomorphisms 

J^(D-M) = (DG'J^(M))(-rf) 

for all M e &{G), where = o = Dg o l* , as in Conjecture 1 of%5.7, l:G — >G 
is the inversion map, andl^a is the Verdier duality functor, defined in %E.3. 

Proof. This is a straightforward exercise using Theorem G.6. □ 

^^We thank Dennis for aUowing us to reproduce his proof. It appears that a similar idea was discovered 
independently by several other mathematicians. 
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Corollary G.8 ( Fourier- Deligne transform preserves perversity). The functor 
J- : ^{G) — > Ql{G'^ takes perverse sheaves on G to perverse sheaves on G'. 

Proof. It is well known and easy to see that the functors pr*[d\ and — <^ C take perverse 
sheaves to perverse sheaves. Moreover, since pr' is an affine morphism, it follows from 
Theorem G.3 that JF^ takes Pcrv(G') into '^^-^\G'), and it follows from Corollary G.4 
that takes Perv(G') into p^^°(G"). But ^ J^* by Theorem G.6, so takes Perv(G') 
into f n P^^O(G') = Perv(G'), as desired. □ 

Another fact about the Fourier- Deligne transform that we need is given in Proposition 
G.IO below. It is independent of the previous theorems; indeed, it only uses the following 
property of the torsor S: 

Lemma G.9. Let a : G x G ^ G denote the group operation in G, and let pi2,Pi3 '■ 
G' X G X G ^ G' X G be the projections {g', 91,92) ^^ {g',gi) and {g',gi,g2) ^ {9', 92), 
respectively. Then there is a canonical isomorphism (id^;/ xo)*S = pl2{£) ® P2?,i^) 
Qp/Zp-torsors on G' x G x G. If c : G ^ G denotes the inversion map, there is also a 
canonical isomorphism {idc xl)*£ = S"^ , where denotes the dual ^pl%p-torsor^^ . 

Proof. As before, we may replace G with G'^^'^^ , G' with G* = (G^^''/)*, and £ with the 
universal torsor £^ on G* x G. By definition, £ is then the universal central extension of G 
by Qp/Zp, i.e., if we think of G* x G as a group scheme over G* (where the group operation 
on G* is ignored), then £ is a central extension of G* x G by Qp/Zp which represents 
the universal class in Ext^(G* x G,Qp/Zp). But now the statement is obvious, because 
if we put H — G* X G, then we have a natural identification H Xq* H ^ G* x G x G, 
so that the group operation in H is identified with {ida* xa) : H Xq* H ^ H, the two 
projections H Xq* H ^ H are identified with pi2 and P13, and the inversion map H ^ H 
is identified with (idc* xl). □ 

Proposition G.IO. The Fourier- Deligne transform T : &{G) — >• S^iG') can he naturally 
upgraded to an equivalence of symmetric monoidal categories, where ^(G) is equipped with 
the monoidal structure given by the convolution defined in and S){G') is equipped with 
the monoidal structure given by M Q N — (M N) [—d] . 

Proof. We only check that there are natural bifunctorial isomorphisms J-'{M * N) = 
(JF(M) J^{N))[—d] for all M, N E ^(G); the rest (compatibility with units and associa- 
tivity and commutativity constraints) is straightforward. First we set up some notation. 
Recall the projections 

G'^G'xG^G and pi,p2:GxG — > G. 

As in Lemma G.9, we will write a : G x G ^ G for the group operations and Pi2,Pi3 : 
G'xGxG^G'xG for the projections. We also introduce the projections 

pr : G' X G X G — > G X G (along the first factor), 

^'^The statement of the lemma uses the fact that if >1 is a discrete abelian group, then the category of 
j4-torsors over any scheme X is a rigid monoidal category. 
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Pi,P2 : G' X G X G — > G (onto the second and third factors), 
and pr' : G" X G X G — > G' (onto the first factor). 
Let us now fix M, iV G &{G). By definition, 

^N)= pr;(pr*(M * N) ® C)[d] = pr;(pr*a!(ptM O p^N) O C)[d]. 
We have a cartesian diagram 



G'xGxG 

pr 

GxG 



-^G'xG 

pr 



G 



Hence the proper base change theorem (§E.4) imphes that there is a natural isomorphism 

pr;(pr*a!(ptM ® p^N) O C) [d] ^ pr{(((idG' xa)i-pr*{plM ® p^N)) ® C) [d]. 

Since Pi o pr = and p2 ° pr = P2, we have 

pr*(p*M (8) pIN) ^ piM (g) p2*N. 

Therefore, by the projection formula (§E.4), 

((idc/ xa)\:^r*ip\M ®pIN)) ® (idc xa)\{pi M ® p2* N ® {idc xa)*C). 

But the first statement of Lemma G.9 implies that (idc xa)*C = p\2^ ®Piz^- Putting 
the previous computations together and using the equality pr'o (idc xa) — pr', we obtain 
the first isomorphism in the following chain: 

T{M*N) ^ ^i\{pi*M ®p2*N ®p\^C®p\^C)[d] 

= W\{P12{V^*M ® C) ®p\^{w*N ® c))[d\ 

= pr:pi2! (pl2(pr*M ®C)® pUw*N £)) [d] 

^ pr; ((pr*M ® £) ® Pi2\pUw*N £)) [d] 

^ pr; ((pr*M ® £) (g) pr'*pr;(pr*A^ (g) £)) [d] 

^ pr; (pr*M 0jC)0 pr; (pr* C) [d] 

^ {T{M) ® T{N))[-d]. 

In this chain the second isomorphism follows from pi = pr o pi2 and p2 = pr o P13, the 
third one follows from pr' = pr' opi2., the fourth and sixth isomorphisms follow from the 
projection formula (§E.4), the seventh one follows from the definition, and the fifth one 
follows from the proper base change theorem (§E.4) applied to the cartesian diagram 



G'xGxG 
G'xG 



P13 



^G'xG 



pr 



G 
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This completes the proof. □ 

Finally, we will need to know that the Fourier-Deligne transform works in the equivari- 
ant setting, i.e., it can be defined on the categories ^g{q) used in Section 4. 

Proposition G.ll. Let G be a connected unipotent group over k of nilpotence class < p, 
let g = LogG, let {g,g',S) be a dual pair of unipotent k-groups satisfying the conclusion 
of Corollary F.6, and let ( : Qp/Zp ^ be as before. The Fourier-Deligne transform 
T : — > ^(5') defined in %G.l can he naturally lifted to an equivalence of monoidal 
categories T : S>g{q) ^g{q'), where ^g{q) is equipped with convolution {cf. and 
^0(9') is equipped with the monoidal structure defined by M Q N — (M (8) N) [— dim G] . 

This result is straightforward. One defines the lift of by the same formula as in 
Definition G.l, using the fact that the local system C on q' x g has a G-equivariant 
structure coming from that on S together with the remarks in §E.6. Then one easily 
verifies that the proofs of all the results in this subsection go through in the equivariant 
setting by checking that each step is compatible with the G-equivariant structures. The 
details are left to the reader. 



Appendix H. Some counterexamples related to the orbit method 

Let us briefly fix our conventions and describe some of the counterexamples presented 
in this appendix. We use the setup and notation of Section 2. In particular, T will denote 
a p-group of nilpotence class < p and Q — Log(r) will denote the corresponding Lie ring. 
Recall from §2.3 that the composition 

$ : Cr ^ Meas(r) ^ Meas(0) Fun{g*) (H.l) 

restricts to an algebra isomorphism between the center ZF of CF and the algebra Fun(g*)'" 
of F-invariant functions on q*. One of the goals of this appendix is to show that the 
composition (H.l) is not an isomorphism of XT -m,od,ules, where the ZF-module structure 
on Fun(g*) is induced by the isomorphism ZF ¥un[Q*Y . 

If / e 0* and Q C 0* is the F-orbit of /, we denote by pn the irreducible representation 
of F associated to Vl via the orbit method. We write F-'^ for the stabilizer of / in F and g^ for 
the Lie subring of g corresponding to F-'^; one can check (cf. [Ki62, BSx]) that g^ coincides 
with the kernel of the natural alternating bilinear form iJ/igxg— associated to 
/, so the restriction of / to g^ is a Lie homomorphism^^ g^ — > C^. Therefore it defines 
a group homomorphism Fj C^. Wc present a counterexample below showing that in 
general the representation of F induced by this group homomorphism is not isomorphic to 
a multiple of the representation pa. 



This also follows from the F-^'-invariance of / : fl-^ — > C^. 
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H. 1. Statements to disprove. Our goal is to show that each of the following statements 
is false in general: 

(1) The representation of F obtained from inducing the 1-dimensional representation of 

defined by / is isomorphic to a multiple of p^. 

(2) Every Lie subring f) C g satisfying /([f), f)]) = {1} is contained in a polarization of g 
at /. 

(3) The composition (H.l) is an isomorphism of ZF-modules, where Fun(g*) is a ZF- 
module via the algebra isomorphism ZF Fun(0*)^ mentioned above. In other 

words, ^{xy) = whenever x G ZF and y G CF. 

On the other hand, it is a simple exercise to prove that all three statements hold when 
the nilpotence class of q is at most 2. 

H.2. A counterexample to (1) and (2). Let Xf denote the 1-dimensional character 
of F-'^ defined by /. It follows from the orbit method [Ki62, BSx] that the irreducible 
summands of the induced representation Indp/(x/) correspond to those coadjoint orbits 
in Q* that intersect f+{Q-^)'^ nontrivially. Thus, (1) is equivalent to / + C Q, which 
by counting is equivalent to / + (q^)^ = fi- To find a situation where this fails, let q be 
odd, and let g be the Lie algebra over with basis ,t, y, z, t and commutation relations 

[x,y]^z, [x,z]^t, [y,z]^0, [i,g] = (0). 

Define / hy f = ip o p, where p : ^ Fg is defined by p{x) = p{y) — p{z) = 0, 

p{t) = 1, and ip : ¥g ^ is a nontrivial additive character of F^. One can easily check 
that / + ^ flin this case: for instance, exp(ada;)(|/) = y+t/2, so that Ad*(e^)(/)— / 
does not vanish on y, whereas y G g^. 

This construction also provides a counterexample to statement (2) of §H.l. Namely, 
f) := span(x, t) is an abelian subalgebra of g, and we claim that f) is not contained 
in any polarization of g at /. To prove this, notice that any polarization at / must 
contain g-^, whereas [) and g-^ together generate g as a Lie algebra, because y E Q-^ . Since 
/([fljfl]) 7^ {!}) we see that [) cannot be contained in any polarization of g at /. 

H.3. Properties equivalent to (3). Recall that our property (3) says that the map 
$ defined by (H.l) is an isomorphism of ZF-modules, i.e., ^{xy) = $(a;)$(y) whenever 
X G ZF and y G CF. We will formulate some properties equivalent to (3), and then we 
will show that they do not hold in general. 

For every orbit Q C g* let be the kernel of the corresponding representation of 
CF; so is a two-sided ideal of CF. Let J{Q) C Fun(g*) be the ideal of functions 

that vanish on Q and K{Q) C Fun(g*) the ideal of functions supported on fl. Remark 
2.6 implies that (3) is equivalent to each of the following properties: 

(4) for every orbit fl the composition (H.l) takes onto J{^); 

(5) <^>-\J{n)) is a left ideal of CF for every orbit fl; 

(6) ^-\K{n)) is a left ideal of CF for every orbit Q. 
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Note that since $ ^{J{Q)) and $ ^{K{Qj) are stable under F-conjugation, one can replace 
the word "left" in (5) and (6) by "right" or "two-sided". 

Let Perm(Q) denote the permutation representation of F associated to the F-action 
on Q. Since $ commutes with F-conjugation property (4) implies that Cr/I[Q) and 
Fun(0*)/J(O) are isomorphic as F-modules, which is equivalent to the following property: 

(7) The F-module Perm(Q) is isomorphic to (g) p^. 

So a counterexample to (7) would also be a counterexample to (3)- (6). In the next 
subsection we will construct a counterexample to (7) in which g has nilpotence class 4. 
Then we will show that (7) holds whenever the nilpotence class of is at most 3, while 
(3)- (6) can already fail when q has nilpotence class 3. 

H.4. Counterexample to (7). This subsection is close in spirit to a work by F. du 
Cloux (see §H.6). We will only consider the case where is a Lie algebra over F^, rather 
than an arbitrary Lie ring. In this case q* will be identified with the underlying additive 
group of the dual vector space Homir^(0, F^). (The identification depends on a choice of 
a nontrivial additive character F^ C^. This choice is irrelevant in what follows.) We 
consider a coadjoint orbit C g* as a closed subvariety. In particular, the tangent bundle 
TQ is defined. However, we do not need TQ as a variety, but only as a set, namely, the 
set of pairs (/, A), where f E and A e TfQ = q/q-^; the latter will be thought of as a 
subspace of Q*, namely, the image of the linear map — > 5* induced by the form Bf. 

We want to compare the character of pu Pq and that of Perm(r2). The former is the 
Fourier transform of the measure ^ on 0* defined hy p = {l/\fl\) ■ {dd*S-n). Equivalently, 
p{X) = |7r^^(A)|/|f2|, where A G 0* and n — n^i : Q x Q, ^ q* is the subtraction map 
(/) 9) ^ f ~ 9- The latter is the Fourier transform of the measure p on 0* defined by 
p{X) — |7f~"^(A)|/|n|, where vf = tt q : Tfl — > 0* is the natural map, (/, A) 1— > A. (Note that 
ttq is a "degeneration" of ttq because one can think of a point of Tfl as a pair of infinitely 
close points of Q.) 

Thus Pa,® ph. — Perm(f2) if and only if 

kn'(A)| = |^f,'(A)|forallAe0*. (H.2) 

Observe now that the maps tt and tt make sense for any smooth closed subvariety Y of 
an affine space A over F^ (they take values in the vector space V corresponding to A), 
and we can ask the same question: is it true that |7r~^(A)| = |7r"^(A)| for all X E V7 li Y 
is the affine space itself the answer is "yes" . 

Exercise H.l. If q is odd and Y is a parabola in the affine plane, the answer is also 
"yes". 

Usually the answer is no. E.g., the answer is negative for the following curve Y. 

Exercise H.2. Let Y := {{t,t'^,t^) G 1 1 e ¥q}, and suppose that char(Fg) > 5. Then 
the maps tt and tt have different images. 
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Now we can give a counterexample to (7). We assume that charFg > 5. Let g be a 
semidirect product of a 1-dimensional subalgebra c C generated by an element v & c and 
a 4-dimensional abclian ideal a C 3 so that (adf )^ = and (adf )^ 7^ (i.e., adv : a —>■ a 
is a generic nilpotcnt operator). Let Q' C a* be a generic C-orbit, C := Exp c; here 
"generic" means that Q' is not contained in the kernel of (ad* v)^ : a* — > a*. Let Q be the 
preimage of Q' in q*; it is easy to see that Q is a F-orbit. 

Exercise H.3. Equality (H.2) does not hold for Q. 

Hint: Q' can be identified with the curve from Exercise H.2. 

In the construction above it is not enough to take dim a = 3 (in this case Q' can be 
identified with the parabola from Exercise H.l). More generally, we have the following 

Theorem H.4. If q has nilpotence class < 3 then q satisfies property (7), i.e., pn^Pn — 
Perm(n) for every coadjoint orbit fl <Z Q*. 

Proof. Let ad* : q — > Endg be the coadjoint action, i.e., ad* a; := —(ad a;)*. Recall that 
for / e 0*, we denote by its stabilizer in g. Now fix /, let denote its F-orbit, and let 
TT, TT be as above. It is easy to see that jg-^p • |7r'~-'^(A)| is the number of solutions of the 
equation 

(e^'*^-e^'*^)(/) = A, x,yeg, (H.3) 
and \g-^\'^ ■ |7f~^(A)| is the number of solutions of the equation 

e^'^* ' (ad* u{f )) = A, z,ueQ. (H.4) 

Thus it suffices to establish a bijection between the sets of solutions of these two equations. 
We leave it to the reader to check that the change of variables x = log(e^e"/^), y = 
log(e^e~"/^) transforms (H.4) into (H.3); here we are using the equality e^* ^ ad* u — 
gad* z ^gad* w/2 _ g-ad*u/2^^ which holds because (ad*ii)^ = 0. This change of variables is 
invertible: u = log(e-2'e-^), z = log(e2'e"/2) = log(e2'(e-2/e^)V2). □ 

H.5. Counterexample to (3)-(6) of nilpotence class 3. Statement (3) was formu- 
lated in §H.l and the equivalent statements (4)-(6) were formulated in §H.3. We will 
show that they already fail in a counterexample similar to the one given in §H.4, but with 
dim = 3 instead of dim a = 4. 

First of all, property (6) can be reformulated as follows: 

(6') for every A G g* and 7 G F the function 

X A(log(7e'')), X e Q 

is a linear combination of the characters from the F-orbit fix 3 X. 

Now suppose that 

(i) is a semidirect product of a 1-dimensional subalgebra c C g generated by an 
element v e c and an abelian ideal C g, 

(ii) the restriction of A to (adi')^(a) is nontrivial. 
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Then (6') cannot hold. For if it does, then the function 

X ^ A(log(e^e^)), xea (H.5) 
must be a hnear combination of characters of a of the form 

x^\{e*^''x), te¥q. (H.6) 

On the other hand, since a is abehan the Campbell-Hausdorff formula tells us that the 
function (H.5) is proportional to the character 

A(x + ^Ci(adt')*x), xea, (H.7) 

i>0 

where q e ^[ (^-1)1 ] certain universal coefficients; in particular, ci = 1/2 and C2 = 
1/12. Since C2 7^ c\/2, the character (H.7) does not have the form (H.6). 

H.6. Du Cloux's theorem. The results of §H.4 above are similar in spirit to a theorem 
by F. du Cloux [dC81]. Its statement is as follows. Let g be a finite dimensional nilpotent 
Lie algebra over a field k of characteristic 0, let G = Exp g be the corresponding unipotent 
group over k, let q* = Homfe(0, k), let S{q) denote the symmetric algebra of g (viewed as 
the algebra of polynomial functions on g*), and let U{g) denote the universal enveloping 
algebra of q. Thus S{g) is the analogue of the commutative algebra Fun(0*) considered 
above, and U{g) is the analogue of the group algebra CF. If 1] C 0* is a G-orbit, let 
J{fl) denote the ideal of functions in S{g) that vanish on fl, and let C U{g) denote 
the kernel of the representation of U{g) associated to fl by Kirillov's theory. Assume 
moreover that dimJl = 2. Then S{g)/J and U{g)/I are isomorphic as g-modules with 
respect to the adjoint action if and only if Q has degree <2 as a subvariety of g* . 
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